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Appendix  I 


PROJECT  MEMORANDA 


Appendix  I  includes  the  following  materials: 


A*  Memorandum  for  Item-Writers,  containing  information 
and  instructions  prepared  for  the  individuals  who 
constructed  test  items 

B.  Memorandum  for  Test  Critics,  containing  information, 
instructions,  and  illustrative  material  for  persons 
professionally  engaged  in  scientific  work  who  were 
asked  to  criticize  test  items 

C.  Memorandum  for  Editorial  Revierer,  containing  explana¬ 
tion  of  materials  and  instructions  for  the  editorial 
critic  who  was  asked  to  review  final  tryout  forms  of 
the  test 

D.  Memorandum  for  Rationale  Reviewers,  containing  expla¬ 
nation  of  materials  and  instructions  for  critics  who 
were  asked  to  review  the  rationales  prepared  for  each 
item  as  well  as  the  items  themselves 
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PROJECT  FOP.  THE  DEVELOPMENT  OF  SELECTION  INSTRUMOiTS 
TO  MiAEoRE  APTITUDES  FOR  SCIENTIFIC  WORK 

MEMORANDUM  FOR  ITEiA-WRIIERS 

Introduction 

The  present  test  development  project  sponsored  by  the  Office  of 
Naval  Researchy-is,  a  continuation  study  undertaken  upon  completion  of  an 
earlier  project  resulting  in  the  deterndnatie n  of  the  critical  requirements 
for  scientific  personnel.  The  enclosed  list- 7f  critical  requirements  is 
the  outcome  of  that  study  j  and  will  serve  as  the  basic  data  for  the  present 
project. 

The  objective  of  the  present  research  i-e— the  development  of  se¬ 
lection  instruments  to  measure  aptitudes  for  scientific  work.  Specifically* 

V 

it  is  intended  to  develop  test  items  to  predict  the  critical  requirements 
identified  earlier.  Since  the  methodology  of  the  test  development  project 
rests  to  a  great  extent  upon  that  of  the  preceding  study*  a  summary  of  the 
procedures  followed  in  determining  the  critical  requirements  is  given  below. 
Determination  of  the  Critical  Requirements 

The  critical  requirements  are  based  on  detailed  descriptions  of 
observed  on- the- Job  behaviors  which  were  Judged  by  the  observer  as  partic¬ 
ularly  effective  or  ineffective.  Five  hundred  senior  research  and  engi¬ 
neering  personnel  in  the  major  Naval  scientific  laboratories  were  inter¬ 
viewed  and  asked  to  describe  incidents  illustrating  Job  behaviors  which 
they  considered  particularly  effective  or  ineffective.  The  interviewing 
sample  represented  roughly  IO56  of  the  total  population  of  Civil  Service 
professional  grades  4  and  above  in  Navy  laboratories.  The  various  Job- 
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title  groups  were  sampled  in  proportion  to  their  numbers  in  the  population, 
and  included  most  of  the  physical  science  and  engineering  groups;  biologi¬ 
cal  and  social  science  were  not  included.  All  scientific  and  engineering 
functions  were  represented  by  the  jobs  of  persons  interviewed,  from  basic 
and  applied  research  to  design,  development,  testing,  and  production  engi¬ 
neering. 

Over  3>000  critical  behaviors  were  described  in  the  incidents  ob¬ 
tained.  The  behaviors  were  then  classified  and  formulated  into  a  list  of 
critical  requirements  through  grouping  of  closely  similar  and  related  be¬ 
haviors.  The  final  formulation  consists  of  eight  major  areas,  each  con¬ 
taining  a  number  of  submareas.  The  organization  of  the  behavior  groupings 
was  developed  primarily  by  considering  the  sequences  and  functions  in 
scientific  and  engineering  work* 

Rationale  of  the  Test  Development  Project 

As  was  stated  above,  the  project  objective  is  the  development  of 
test  items  for  the  enclosed  list  of  critical  requirements.  It  is  intended 
that  the  test  be  applicable  to  the  selection  of  personnel  for  positions  in 
research  and  engineering  laboratories.  It  should  be  particularly  applicable 
for  administration  at  the  college  senior  level  to  select  candidates  for  ad¬ 
vanced  training  in  physical  science  and  engineering. 

The  specific  behaviors  given  in  the  list  serve  as  the  basic  data 
which  determine  the  numbers  and  kinds  of  items  to  be  developed.  Items  will 
be  prepared  by  studying  the  critical  behaviors  and  constructing  items  in 
which  each  of  these  behaviors  forms  the  basis  for  one  or  more  test  problems. 

The  rationale  for  each  of  the  various  types  of  items  will  be  as 
tightly  logical  as  possible.  For  example,  the  reasoning  would  not  be  of 
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the  type:  "A  number  of  men  failed  because  of  inability  to  understand  writ¬ 
ten  materials.  Understanding  of  written  materials  is  measured  by  the  ver¬ 
bal  factor*  A  test  of  the  verbal  factor  is  the  Cooperative  Vocabulary  Test* 
The  Cooperative  Vocabulary  Test  should  provide  a  valid  measure  of  this  criti¬ 
cal  requirement  of  an  effective  research  worker,"  Instead,  such  more  detailed 
definitions  will  be  required  of  the  type  of  materials  not  understood*  The 
inf eroncea  made  will  be  much  more  restricted*  The  final  items  developed 

t 

will  have  to  appear  to  representative  scientists  serving  as  oritics  as  clear¬ 
ly  relevant  to  the  requirements  being  predicted* 

Guiding  Principles  in  Item  Construction 

It  is  intended  that  the  test  shall  measure  aptitude  rather  than 
academic  achievement  or  knowledge  gained  through  technical  experience*  For 
this  reason  it  is  essential  that  all  specific  inf  rmation  necessary  to  the 
solution  of  test  items  be  given  so  that  the  subject's  success  or  failure  on 
specific  items  will  depend  upon  his  ability  to  manipulate  information  in  a 
desired  manner;  ar.d  not  on  his  possession  of  that  information.  However,  a 
minimum  knowledge  of  general  principles  in  the  basic  physical  sciences  will 
probably  be  operative.  It  is  therefore  assumed  that  all  individuals  will 
havo  a  minimum  common  background  of  a  year's  college  course  in  physics,  in 
chemistry,  in  mathematics.  However,  each  individual's  background  in 
these  ,i"cas  will  vary  with  tne  field  of  specialization,  and  since  it  is  do- 
sired  that  individuals  in  all  the  physical  and  engineering  sciences  shall 
take  the  test  without  the  results  being  unduly  influenced  by  course  back¬ 
ground,  a  balance  of  subject-matter  content  will  be  necessary.  Host  of  the 
subject-matter  wilx  be  taken  from  physics,  chemistry,  and  sathenatics,  but 
a  limited  number  of  items  concerned  with  engineering  and  biological  science 
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may  be  Included  if  presented  so  that  no  special  advantage  or  disadvantage 
will  be  given  to  particular  groups. 

It  is  also  desirable  that  situations  described  in  particular  items 
should  seem  appropriate  in  both  a  university  and  a  research  laboratory  sit¬ 
uation,  Since  some  individuals  will  take  the  test  without  the  benefit  of 
on-the-job  experience,  they  should  not  be  called  upon  to  handle  items  where 
such  experience  would  be  crucial  to  the  solution. 

Since  the  test  may  ultimately  bo  administered  by  ihe  Civil  Service 
Comnission,  the  items  must  be  of  the  objective  type.  It  is  believed  that 
the  five-choice  item  will  be  most  useful,  but  the  test  will  not  necessarily 
be  limited  to  that  type.  On  the  whole,  items  will  require  rather  detailed 
presentation  of  information  essential  to  their  solution.  Since  many  of  the 
critical  requirements  are  related,  it  would  be  desirable  to  relate  a  number 
of  questions  to  a  single  detailed  paragraph  description.  This  would  have  a 
double  advantage  in  making  the  maximum  use  of  the  materials  in  the  paragraph 
and  in  permitting  the  measurement  of  the  integration  of  knowledge  about  a 
aeries  of  related  problems. 

Suggestions  for  Preparation  of  Items 

1,  It  is  desired  that  items  closely  related  to  specific  critical  behaviors 
be  developed, 

2,  Test  items  should  be  objective  (preferably  five-choice)  and  all  speci¬ 
fic  information  r.ecaaaary  for  solution  should  be  given, 

3,  Whenever  possible,  items  should  be  constructed  for  a  group  of  logically 
related  behaviors  by  preparing  detailed  reference  or  descriptive  mater¬ 
ial  end  presenting  a  series  of  questions  concerning  it. 
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The  situations  and  problems  used  in  writing  items  should  preferably  be 
original*  Subject-matter  sources  may  be  consulted  when  necessary,  but 
any  materials  taken  from  them  are  to  be  altered  so  that  no  special  ad¬ 
vantage  will  be  had  by  those  who  know  the  source* 

rfe  would  prefer  to  have  items  typed  on  5  x  8  cards  with  the  correct  al¬ 
ternate  keyed  on  the  back*  Alternate  choices  should  be  numbered  (1,  2, 
3,  I*,  etc,)  Each  item  should  be  coded  to  the  area  (Roman  numeral)  sub- 
area  (capital  letter)  I  or  E  for  effective  or  ineffective  and  item 
(email  numeral)  for  which  it  waa  written*  A  brief  statement  of  what 
the  test  item  is  believed  to  measure  should  be  given  on  the  back  of  the 
card.  Please  sign  or  initial  all  items  prepared* 


The  American  Institute  for  Research 


September  191*9 


PROJECT  FOR  mb  DEVELOrtiENT  OF  SELECTION  INSTRUMENTS 
TO  MtASURK  APTITUDlS  FOR  SCIENTIFIC  WORK 

MtMORAMDMi  FOR  TEST  CRITIC 

The  Office  of  Naval  Research  is  currently  sponsoring  a  project 
concerned  with  the  development  of  an  aptitude  test  for  the  selectmen  of  re¬ 
search  personnel*  The  project  is  being  carried  out  by  the  American  Insti¬ 
tute  for  Research,  a  non-profit  personnel  research  organisation,  and  is  a 
continuation  study  undertaken  after  completion  of  an  earlier  project  which 
resulted  in  the  identification  of  the  critical  requirements  for  research 
personnel* 

The  objective  of  the  project  is  the  development  of  test  items  to 
be  used  in  the  selection  of  candidates  for  advanced  training  in  natural 
science  and  engineering.  The  numbers  and  kinds  of  problems  sampled  by  the 
teat  itaas  are  based  on  the  list  of  critical  benaviora  found  in  ths  pre¬ 
ceding  study*  It  is  not  intended  to  measure  knowledge  or  experience,  but 
rather  to  determine  how  well  the  individual  can  solve  a  new  problem  when 
all  of  the  necessary  technical  information  is  given.  The  items  contain 
problems  in  a  variety  of  subject-matter  areas,  but  are  intended  to  be 
equally  difficult  for  persons  trained  in  a  variety  of  technical  special¬ 
ties.  It  is  assumed  that  all  who  take  the  test  will  have  had  at  least  one 
ysar!s  college  training  in  physics,  chemistry,  arid  mathematics.  All  perti¬ 
nent  technical  information  beyond  this  level  is  given  in  the  statement  of 
eacn  problem,  so  t*wt,  persons  unfamiliar  with  the  particular  field  will  not 
bo  at  a  disadvantage. 
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A  number  of  items  have  been  developed,  each  containing  a  statement 
of  the  problem  to  be  solved,  and  five  possible  answers  from  which  the  cor¬ 
rect  one  is  to  be  selected.  The  items  are  still  in  a  preliminary  form,  but 
it  is  essential  that  they  be  reviewed  by  scientifically  trained  critics  at 
this  stage.  Criticism  vvill  bo  particularly  helpful  if  it  is  directed  at  the 
following  two  points: 

1,  Would  you  expect  successful  solution  of  the  item  to  be  predictive 
of  3nccese  in  the  area  of  behavior  the  item  was  intended  to  meas¬ 
ure? 

2,  Do  you  consider  the  intended  answer  the  only  correct  choice,  or 
clearly  the  best  choice  of  those  offered? 

Samples  of  two  items  and  criticisms  that  have  been  applied  to 
them  are  given  below.  Each  item  is  given  in  the  left-hand  column,  begin¬ 
ning  with  a  brief  paragraph  stating  the  problem  to  be  solved,  and  followed 
by  the  five  possible  choices.  The  answer  intended  as  correct  is  indicated 
by  an  "X::»  Below  each  item  are  statements  which  indicate  the  type  of  be¬ 
havior  which  the  item  was  designed  to  predict. 

Criticisms  are  given  in  the  right-hand  column,  opposite  the  item 
to  wftich  they  apply.  Each  critical  comment  is  numbered  1  or  2  to  correspond 
with  the  two  types  of  criticism  requested. 


ITEM  1 


CRITICAL  COMMENTS 


Any  field  of  energy  is  distorted  by 
whatever  device  is  employed  for  ob¬ 
serving  it.  This  implies  that 

1.  it  is  pointless  to  speak  of  fields 
of  energy, 

X  2,  quantitative  statements  about 

given  fields  of  energy  must  take 
into  account  the  characteristics 
of  the  observing  instrument. 


1,  The  item  does  not  apply  directly 
to  "making  provision  for  equated 
conditions";  it  is  more  concerned 
with  ability  to  determine  the 
logical  implications  of  a  state¬ 
ment. 
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3*  exact  quantitative  laws  cannot  2*  Choice  3  could  be  considered 
be  determined  for  fields  of  right  as  well  as  2,  since  it  is 

energy*  an  implication  of  the  statement, 

though  not  as  obvious  an  impli- 
ii,  some  other  means  of  observing  cation, 

fields  of  energy  should  be 
sought. 

5.  whatever  is  meant  by  “field  of 
energy"  should  be  made  more 
specific. 


Intended  to  predict: 


Planning  and  Designing  the  Investigation  (Major  Area) 

Identifying  and  Controlling  Important  Variables  (Sub-area) 

Made  provision  for  equated  conditions  in  planning  comparison  tests 
(Critical  Behavior) 


ITEM  2 

You  are  performing  a  test  involving 
colorimetry.  You  have  never  performed 
the  test  before,  but  you  have  a  manual 
of  standard  procedures.  Your  task  is 
to  match  the  color  of  an  unknown  sub¬ 
stance  with  a  standard.  This  is  done 
by  adding  a  solution  to  the  unknown 
until  you  have  the  desired  match  and 
recording  the  amount  of  solution  that 
was  required.  You  perform  the  test 
twice  and  obtain  two  different  read¬ 
ings.  What  should  you  do  in  order  to 
decide  on  a  proper  reading? 


CRITICAL  COMMENTS 

1.  Yes,  the  item  should  predict  what 
is  indicated. 

2,  #5  is  the  only  correct  choice  if 
it  means  "do  something  other  than 
1,  2,  3,  or  however,  it  is 
not  clear — it  could  mean  "use 
some  procedure  other  than  color¬ 
imetry  procedures." 


1.  Use  your  first  reading,  since  the 
unknown  substance  might  be  unstable, 

2,  Use  your  second  reading,  since 
practice  has  probably  improved  your 
skill. 


3.  Take  an  average  of  the  two  read¬ 
ings. 

In  Have  another  person  run  the  test 
and  use  that  one  of  the  two  values 
that  is  nearest  to  the  one  obtained 
by  him, 

X  5,  Some  procedure  other  than  those 
mentioned  above. 


Intended  to  predict: 


Planning  and  Designing  the  Investigation  (Major  Area) 

Determining  the  Number  of  Observations  (Sub-area) 

Reported  investigation  complete  only  after  data  had  been  taken  in 
sufficient  quantity  to  permit  conclusive  interpretation  (Critical 
Behavior) 
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American  Institute  for  Research 


13  December  191# 


PROJECT  FOR  THE  Dl\t cLQPuidlT  OF  SELECTION  INSTRUMENTS 

to  measure  aptitudes  for  scientific  work 

MEMORANDUM  FOR  EDITORIAL  REVIEWER 


The  purpose  of  this  review  of  the  items  is  twofold*  (1)  to  edit 
them  for  technical  (subject-matter)  content,  and  (2)  to  edr' t  for  maximum 
conformance  to  the  principles  of  good  item-construction#  If  time  limita¬ 
tions  force  a  choice,  priority  should  be  given  to  the  first. 

Materials  Enclosed* 

(1)  A  memorandum  describing  background  and  rationale  of  the  test 
development  project 

(2)  A  copy  of  each  of  two  forms  of  the  test  (labeled  MTU  and  BT) 
t.ith  the  keyed  choices  circled;  these  copies  also  contain 
the  responses  of  examinees  to  each  choice  for  all  itca” 
where  tryout  data  are  available.  A  description  of  tryout 
groups  is  also  given, 

(3)  A  second  (blank)  copy  of  each  of  the  two  forms  intended 
for  editorial  notes 


Editorial  Comment  Requested* 

(1)  Specific  changes  recommended,  to  be  written  into  the  items 
themselves 

(2)  Brief  explanation  of  reasons  for  changes  and  any  comments, 
questions,  or  reservations  about  specific  items 


9 


% 


American  Institute  for  Research 


15  December  19i$ 


PROJECT  FOR  THE  DEVELOPMENT  OF  SELECTION  INSTRUMENTS 
TO  MEASURE  APTITUDES  FOR  SCIENTIFIC  WORK 

MEMORANDUM  FOR  RATIONALE  REVIEWERS 


Enclosures t 

(1)  A  memorandum  describing  the  background  and  rationale  of  the  testj  (ne 
suggest  you  scan  this  for  general  information). 

(2)  A  set  of  "rationales”  for  1$0  items;  each  of  these  contains  a  critical 
behavior  listed  under  the  appropriate  major  area  and  subarea.  Then  follows 
a  statement  of  our  hypothesis  as  to  the  processes,  abilities,  or  traits 
which  are  believed  necessary  for  the  performance  of  that  behavior.  Stapled 
to  each  of  these  statements  is  a  keyed  test  item  (or  items)  prepared  for  the 
critical  behavior  and  growing  out  of  the  indicated  rationale.  The  last  para¬ 
graph  of  each  rationale  relates  the  specific  item  (or  items)  to  the  critical 
behavior  and  rationale.  The  first  rationale  in  the  group  has  all  of  these 
elements  labeled  for  your  information.  (This  is  the  material  we  would  like 
to  have  you  criticise.) 

(3)  The  Observational  Record  Form  for  Scientific  Personnel,  which  contains 
all  of  the  critical  behaviors  organized  under  the  major  areas  and  subareas; 
(this  is  sent  along  for  reference), 

(li)  A  set  of  sample  critical  incidents,  giving  two  or  three  incidents  for 
each  subarea;  these  incidents  are  illustrative  of  the  data  from  whicn  the 
critical  behaviors  were  formulated.  (These  are  included  in  case  you  wish 
to  see  the  general  form  of  the  critical  incidents.) 

Specific  Directions: 

The  major  purpose  of  this  review  of  the  test  is  to  obtain  critical 
judgments  of  how  well  the  types  of  items  developed  fulfill  the  intended  pur¬ 
poses.  On  each  page,  one  of  the  critical  behaviors  is  presented.  The  ra¬ 
tionale  which  follows  states  our  hypothesis  as  to  how  behavior  of  this  speci¬ 
fic  type  can  best  bo  predicted;  the  items  represent  the  attempt  to  do  so. 

Criticize  the  hypothesis  (rationale)  and  the  item.  Will  perform¬ 
ance  on  this  type  of  item  predict  the  critical  beh&vlor  in  the  job  situation? 

We  are  interested  in  identifying  those  types  of  items  which  will, 
and  those  which  will  not,  predict  the  critical  behaviors.  For  those  which 
you  believe  vdll  not,  we  would  like  to  know  what  changes  will  make  them  suit¬ 
able,  Since  the  project  is  nearing  completion,  we  are  more  interested  in  the 
improvement  of  these  rationales,  and  to  a  lesser  extent  these  items,  than  in 
entirely  new  ideas.  However,  your  ideas  for  new  ratiouaxes  or  items  will 
certainly  be  welcomed. 

Please  record  your  comments  in  the  space  below  each  rationale,  and 
suggested  item  changes  on  the  attached  copy  of  the  item.  Also  please  consider 
each  set  in  order  since  the  orders  aro  staggered  for  the  different  reviewers 
to  achieve  maximum  coverage. 

As  an  Incidental  part  of  the  review,  you  may  wish  to  suggest  edi¬ 
torial  changes  based  on  the  technical  requirements  of  a  good  item.  This,  how¬ 
ever,  is  not  the  major  purpose  of  the  review, 
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Appendix  II 


CRITICAL  REQUIREMENTS  FOR  RESEARCH  PERSONNEL 


Appendix  II  contains  the  list  of  critical  requirements 
for  research  personnel  developed  in  a  preceding  study. 
The  list  is  based  on  job  behaviors  reported  by  scienti¬ 
fic  personnel  as  crucial  to  successful  performance  in 
natural  science  and  engineering.  These  job  behaviors 
represent  the  basic  data  to  which  the  test  development 
project  was  referred.  Each  test  i  was  desire  l  to 
predict  a  specific  critical  behavior, 

The  behaviors  wore  grouped  under  eight  major  areas  and 
thirtv-rd:;  subareas.  They  are  bore  presented  in  outline 
for.u;  hr  3  mr.jcr  area  (Roman  nu;,t:ral)  is  given  first,  and 
then  ihr  subarea  (capital  letter).  The  appropriate  list 
of  eile'/ivo  and  ineffective  behaviors  follow  each  sub- 
area  heaaing. 
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CRITICAL  REQUIREMENTS  TOR  RESEARCH  PERSONNEL 


1*  Formulating  Problems  and  Hypotheses 
kt  Identifying  and  Exploring  Problems 
Effective  Behaviors 

1,  Investigated  chance  findings  or  conments  suggesting  a  new  problem* 

2,  Investigated  unexpected  results  or  difficulties  encountered  in 
work. 

3,  Chose  for  investigation  a  problem  for  which  solution  was  urgently 
needed. 

iu  Suggested  a  new  problem  which  could  be  studied  with  an  already 
successful  technique. 

5,  Proposed  an  entirely  new  problem  or  line  of  research, 

6,  Suggested  that  a  previously  unsolved  problem  ^ould  be  studied 
with  methods  cr  materials  recently  made  available, 

7,  Conducted  preliminary  investigation  to  see  whether  phenomena 
merited  experimental  as  well  as  theoretical  study, 

8,  Conducted  pre] iminary  investigation  to  furnish  basic  data 
essential  to  work  on  a  practical  problem,, 

9,  Applied  material  from  a  current  course  of  study  to  problem. 

Ineffective  Behaviors 

1.  Failed  to  investigate  chance  findings  or  comments  suggesting  a 
new  problem, 

2.  Failed  to  investigate  unexpected  results  or  difficulties  en¬ 
countered  in  work, 

3.  Worked  on  a  problem  which  had  already  been  solved  or  proved 
unproductive. 

It,  Allowed  a  successful  technique  to  be  dropped  without  further 
application  to  new  problem, 

5.  Overlooked  a  problem  in  current  work  meriting  further  research. 

B.  Defining  the  Problem 
Effective  Behaviors 

1,  Proposed  investigation  of  basic  factors  and  implications  in¬ 
volved  in  the  problem  as  well  as  its  superficial  aspects, 

2,  Defined  the  problem  and  objectives  of  investigation, 

3,  Gathered  information  on  exact  requirements,  specif icatiuns, 
and  goal  of  assigned  project, 

ii.  Proposed  investigating  only  factors  which  could  be  studied 
in  time  available, 

5,  Outlined  investigation  of  only  those  factors  whose  control 
was  feasible. 

6,  Submitted  a  plan  covering  both  theoretical  and  experimental 
aspects  of  problem. 

Ineffective  Behaviors 

1,  Proposed  an  investigation  confined  to  superficial  aspects  of 
problem, 

2,  Began  work  without  defining  problem  or  objectives  of  investi¬ 
gation. 

3,  Failed  to  obtain  information  needed  to  define  the  requirements, 
specifications,  and  goal  of  assigned  project, 

U.  Chose  a  problem  which  did  not  lend  itself  to  investigation  be¬ 
cause  of  practical  limitations, 

11 


A 


C,  Setting  Up  Hypotheses 
Effective  Behaviors 


1*  Proposed  hypothesis  or  general  formula  in  order  to  explain 
observed  phenomena* 

2,  Predicted  phenomena  by  theoretical  or  mathematical  analysis* 

3*  Extended  a  theory  to  cover  a  broader  range  of  problems* 
h*  Reformulated  a  theory  to  improve  its  explanation  of  the  facts* 

5,  Applied  theory  from  another  field  to  explain  observed  phenomena* 
6*  Provided  explanation  of  phenomena  derived  from  analogous 
situation  in  the  same  field* 

Ineffective  Behaviors 

1.  Proposed  program  of  data  collection  undirected  by  any  hypothesis* 
2*  Proposed  hypothesis  contrary  to  known  facts* 

II*  Planning  and  Designing  the  Investigation 
A*  Collecting  Background  Information 
Effective  Behaviors 

1*  Sought  out  information  and  ideas  from  existing  literature* 
associates*  or  experts  on  problem  before  beginning  work  on 
project. 

2*  Included  all  relevant  sources  in  surveying  the  literature  or 
consulting  experts, 

3*  questioned  the  validity  of  material  in  the  literature* 

U.  Obtained  needed  information  from  an  uncommon  source. 

5.  Made  himself  best- informed  person  in  his  group  on  special 
subject. 

6*  Suggested  that  literature  he  had  read  in  the  past  might  apply 
to  a  current  problem* 

7*  Performed  experiments  or  gathered  necessary  information  direct¬ 
ly  which  was  unavailable  in  usual  sources. 

Ineffective  Behaviors 

1.  Did  not  consult  those  intimately  concerned  with  problem,  or 
investigate  existing  literature  before  beginning  work  on  project. 

2,  Omitted  an  inportant  source  in  surveying  literature  or  con¬ 
sulting  experts* 

3*  Took  action  based  on  information  from  an  unreliable  source* 

B.  Setting  Up  Assumptions 
Effective  Behaviors 

1*  Based  plan  on  assumptions  which  closely  approximated  actual 
conditions, 

2,  Secured  evidence  of  validity  of  assumptions. 

3.  Verified  previous  work  before  basing  assumptions  on  it. 

Ineffective  Behaviors 

1.  Outlined  plan  which  was  dependent  on  false  sssunptions  or 
assumptions  inapplicable  to  specific  problem. 

2.  Failed  to  secure  evidence  of  validity  of  assumptions. 

3.  Based  outline  of  investigation  on  opinion  or  previous  work 
of  others  without  question. 
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C.  Identifying  end  Controlling  inportent  Variables 
affective  Behavior! 

1.  Outlined  plan  permitting  control  and  systematic  variation 
of  all  relevant  variables. 

2.  Made  provision  for  equated  conditions  in  planning  comparison 

tests. 

3*  Simulated  actual  conditions  in  a  laboratory  test. 

1*.  Described  or  outlined  plans  in  which  the  various  factors  were 
treated  in  accordance  with  their  relative  importance. 

5*  Pointed  out  the  significance  of  a  factor  overlooked  or  dis¬ 
missed  as  trivial  by  others. 

Ineffective  Behaviors 

1.  Outlined  plan  for  experiment  without  control  and  systematic 
variation  of  all  relevant  variables. 

2.  Failed  to  make  provision  for  equated  conditions  in  planning 
comparison  teste 

3.  Failed  to  simulate  actual  conditions  in  a  laboratory  test. 

U.  Described  or  outlined  plans  in  which  the  various  factors  were 
not  treated  in  accordance  with  their  relative  importance. 

D.  Developing  Systematic  and  Inclusive  Plans 
Effective  Behaviors 

1.  Included  all  relevant  factors  or  phases  in  outlining  plans  for 
the  investigation. 

2.  Presented  plans  which  included  methods  of  integrating  one  factor 
or  phase  with  others. 

3*  Pointed  out  the  basic  factors  in  a  mass  of  information  about 
the  problem. 

k»  Tried  out  various  approaches  to  problem  before  choosing  one. 

5.  Outlined  plan  calling  for  each  element  of  problem  to  be 
studied  in  sequence. 

Ineffective  Behaviors 

1.  Omitted  a  relevant  factor  or  phase  in  outlining  plans  for  an 
investigation. 

2.  Presented  plans  in  which  one  factor  or  phase  was  conridered 
in  isolation  from  related  phases. 

3.  Listed  an  irrelevant  factor  in  plan  of  investigation. 

E.  Developing  Plans  for  the  Use  of  Equipment,  Materials,  or  Techniques 
Effective  Behaviors 

1«  Included  in  plan  of  investigation  equipment,  material  or  tech¬ 
niques  which  met  the  requirements  of  the  problem. 

2.  Chose  a  simplified  technique  which  produced  results  of  required 
standard. 

3.  Planned  to  use  substitute  equipment  or  material  which  met 
standards  and  saved  time  or  money. 

U.  Planned  to  modify  available  equipment,  materials,  or  techniques 
for  use  on  a  new  problem. 

5.  Planned  to  use  technique  or  equipment  which  would  eliminate 
doubt  of  validity  or  accuracy  of  reaults. 

6.  Chose  the  latest  development  of  an  appropriate  equipment, 
technique,  or  material. 

7.  Conducted  pilot  study  to  determine  feasibility  of  proposed 
techniques,  material*,  or  equipment. 

8.  Set  up  work  for  procedure  in  most  efficient  physical 
arrangement  for  handling  details  easily. 
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Ineffective  Behaviors 


1*  Included  in  plan  of  investigation  equipment)  material*  or 
techniques  not  fitted  to  the  requirements  of  the  problem* 

2.  Planned  to  use  equipment  or  materials  more  complex  or  ex¬ 
pensive  than  necessary  to  produce  results  of  required  standards. 

3.  Suggested  trial  and  error  method  for  a  problem  that  required 
a  controlled,  systematic  approach* 

li,  Overlooked  available  materials,  equipment,  or  techniques 
suitable  to  investigation  in  drawing  up  plans* 

5*  Proposed  use  of  equipment,  material,  or  technique  successful 
in  a  related  field  without  specifying  modifications  necessary 
to  fit  specific  problem* 

6*  Presented  plan  to  use  a  procedure  that  had  never  been  tested* 

7*  Failed  to  suggest  ideas  on  approach  to  problem  or  sources  for 
ideas* 

F*  Anticipating  Difficulties 

Effective  Behaviors 

1*  dade  provision  for  meeting  difficulties  likely  to  arise  at 
later  stages, 

2*  Included  in  plans  internal  or  independent  check  on  accuracy 
of  data  or  method* 

3*  Outlined  probable  consequences  of  various  alternative  approaches, 

U*  Outlined  alternate  approach  to  be  used  if  first  choice  failed* 

5*  Took  special  precautions  in  planning  to  prevent  damage  to 
equipment* 

6.  Organized  work  so  that  changes  could  be  made  easily  when  they 
became  necessary. 

Ineffective  Behaviors 

1*  Made  no  provision  for  handling  difficulties  which  might  arise 
at  later  stages* 

2.  Failed  to  set  up  internal  or  independent  check  on  accuracy  of 
data  or  methods. 

Q(  Determining  the  Number  of  Observations 

Effective  Behaviors 

1*  Outlined  plan  of  investigation  which  provided  for  sufficient 
quantity  of  data  to  be  taken. 

Ineffective  Behaviors 

1.  Outlined  plan  of  investigation  Ttiich  did  not  provide  for  suf¬ 
ficient  quantity  of  data  to  be  taken. 

2,  Outlined  plan  of  investigation  calling  for  the  collection  of 
considerably  more  data  than  necessary* 

Conducting  the  Investigation 

A*  Developing  Methods,  Materials,  or  Equipment 

Effective  Behaviors 

1*  Devised  an  improved  method,  material,  or  equipment, 

2.  Incorporated  ideas  from  another  field  in  developing  a  method, 
material,  or  equipment. 

3.  Developed  an  entirely  new  method,  material,  or  equipment  to 
fill  a  need. 

U,  Adapted  available  equipment  to  meet  requirements  of  new  problem, 

5.  urote  specifications  for  proposed  equipment  from  knowledge 
of  its  purpose. 

.  Showed  experimentally  the  capabilities  of  method,  material, 
or  equipment  he  developed* 
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Ineffective  Behaviors 

1*  Developed  a  new  method  when  appropriate  one  existed. 

2*  Produced  a  new  method*  material*  or  equipment  which  was  less 
effective  than  existing  one* 

3*  Failed  to  make  adaptation  of  existing  method*  material*  or 
equipment  to  permit  its  use  in  a  specific  problem* 

U*  Developed  method*  material*  or  equipment  which  did  not  meet 
assigned  specifications  or  recognized  need* 

5*  Designed  equipment  too  impractical  to  be  produced  or  used* 

B.  Applying  Methods  and  Techniques 
Effective  Behaviors 

1.  Used  a  technique,  material*  or  equipment  which  solved  problem 
or  eliminated  difficulty  in  the  investigation. 

2*  Pointed  out  that  method  or  device  did  not  meet  the  require- 
ments  of  the  Investigation, 

3*  Substituted  a  method*  technique*  or  equipment  giving  results 
better  than  thtf  one  in  current  uee* 

4.  Used  substitute  material  or  simplified  procedure  that  met 
standards  and  saved  monoy  end  time* 

5*  Applied  critical  tests  of  equipment  or  material  correctly. 

6*  Tried  even  unlikely  methods  after  obvious  methods  had  failed* 

7.  Demonstrated  that  material*  technique,  or  equipment  could  be 
used  for  purposes  ether  than  original  ones. 

8*  Taught  himself  to  operate  equipment  without  aupenrielon. 

Ineffective  Behaviors 

1*  Used  equipment*  material*  or  technique  incorrectly. 

2*  Used  a  technique  more  complex  or  expensive  than  necessary  to 
obtain  desired  result. 

3.  Attempted  to  uee  a  method  which  violated  fundamental  laws. 

4.  Followed  standard  procedure  or  suggestion  to  the  letter  with¬ 
out  modifying  it  to  fit  specific  situation. 

3*  estimated  data  when  accurate  methods  of  measurement  were 
available. 

6.  Failed  to  apply  a  method  provided  for  in  plans. 

7.  Failed  or  erred  in  performance  of  a  simple  operation  after 
instruction  or  study. 

6.  Failed  to  find  the  cause  of  difficulty  in  operation  of  equipment. 

9.  Followed  inapplicable  or  unorthodox  methods  in  construction 
or  maintenance  of  equipment. 

C,  Modifying  Planned  Procedures 
bffsetive  Behaviors 

1.  Modified  standards,  methods,  or  work  schedule  to  meet  dead¬ 
line  without  reducing  essential  value  of  results, 

2.  Modified  work  to  incorporate  latest  research  findings, 

3.  Adopted  alternate  procedures  as  soon  as  unforeseen  negative 
conditions  or  difficulties  were  encountered. 

4*  Held  up  phases  of  work  until  results  of  earlier  phase  were 
available, 

5.  Accepted  partial  results  or  temporary  solution  to  an  urgent 
problem, 

6.  Anticipated  the  probable  effect  of  a  defect  or  difficulty 
and  took  appropriate  action. 

7.  Took  emergency  action  which  provanted  damage  or  injury. 


Ineffective  Behavior* 


1*  Failed  to  modify  standards,  methods,  or  work  schedule  to 
meet  deadline* 

2,  Omitted  an  essential  step  or  precaution  for  accuracy  in 
order  to  meet  deadline. 

3.  Continued  to  follow  old  method  or  approach  without  change 
when  evidence  showed  it  had  failed. 

U.  Began  work  on  a  phase  of  project  without  waiting  for 
results  of  earlier  phase. 

5.  Refused  to  accept  partial  results  or  temporary  solution  to 
an  urgent  problem. 

6.  Ordered  a  change  causing  damage,  incorrect  performance,  or 
inaccuracy. 

7.  Abandoned  or  modified  a  method  or  device  before  sufficient 
evidence  had  been  gathered* 

8.  Modified  only  a  part  of  tha  materials  or  procedures  giving  trouble. 

9.  Started  and  abandoned  several  methods  without  following  any 
far  enough  to  justify  rejection* 

D.  Applying  Theory 

Effective  Behaviors 

1*  Performed  an  unfamiliar  calculation  or  operation  without 
instruction* 

2.  Made  an  application  of  new  or  conplex  material  to  own  work 
after  brief  explanation* 

3*  i resented  unique  solution  or  technique  developed  by  mathe¬ 
matical  analysis. 

U.  Transformed  physical  problem  so  that  it  could  be  solved  by 
mathematical  analysis. 

5.  explained  phenomenon  bj  analysing  procedures  used  or  data  obtained. 

6.  Determined  the  purpose  or  operation  of  a  device  by  studying 
its  construction. 

7.  Explained  technical  subjects  or  answered  questions  of  others. 

Ineffective  Behaviors 

1*  Failed  to  solve  a  problem  requiring  only  direct  application 
or  elementary  extension  of  textbook  principles* 

2.  Failed  to  answer  a  technical  question  or  gave  incorrect 
information. 

3.  Presented  an  erroneous  mathematical  solution. 

U.  Requested  repeated  or  more  simplified  explanation  of  a 
theoretical  point. 

5.  Omitted  or  misinterpreted  implications  of  fundamental  theory 
in  explaining  application  to  a  problem. 

E.  Attending  to  and  Checking  Detaile 

Effective  Behavlora 

1.  Followed  ail  essential  details  of  prescribed  procedures  for 
a  routine  operation, 

2.  Performed  work  #iich  met  standards  for  accuracy  or.  project, 

3.  handed  in  work  only  after  he  had  checked  it. 

it.  Held  up  work  vxitil  equipment  was  checked. 

5.  kept  systematic,  detailed  record  of  project,  permitting 
repetition  or  evaluation  of  proceduree. 

6.  Recorded  essentials  of  conference  or  decision  for  super¬ 
visors*  information. 

7.  Called  attention  to  a  significant  detail  or  error  occurring 
in  regular  perforsence  of  duty. 

8.  Checked  results  at  end  of  each  phase  before  proceeding. 
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Ineffective  Behaviors 


1,  Omitted  an  essential  detail  of  prescribed  procedures  for  a 
routine  operation. 

2*  Turned  in  work  itaich  had  to  be  re-done  because  it  contained 
errors, 

3.  Failed  to  check  work  before  handing  it  in, 

U«  Used  equipment  without  first  calibrating  or  checking  it, 

5*  Failed  to  keep  record  of  project,  making  repetition  or 
evaluation  of  procedures  impossible, 

6,  Failed  to  record  essentials  of  conference  or  decision  for 
supervisors'  information, 

7 4  Failed  to  call  attention  to  a  significant  detail  or  error 
occurring  in  regular  performance  of  duty, 

8,  Bid  not  investigate  a  simple  or  obvious  clue  to  cause  of 
phenomenon, 

9,  Gave  disproportionate  time  and  attention  to  small  details  of 
procedure, 

10,  Failed  to  check  on  details  of  procedure  before  beginning  work, 

11,  Took  action  based  on  the  word  of  others  without  checking 
validity  or  applicability, 

F,  Analysing  the  Data 
Effective  Behaviors 

1,  Used  the  most  efficient  method  for  analysing  data. 

Ineffective  Behaviors 

1,  Applied  a  formula  to  his  data  which  could  not  give  required 
information, 

2,  Calculated  statistics  unnecessary  for  data  obtained, 

3,  Failed  to  nake  the  necossary  mathematical  analysis  of  his  data, 

IT,  Interpreting  Research  Results 

A,  Evaluating  Findings 
Effective  Behaviors 

1,  Produced  conclusions  or  recommendations  supported  by  data. 

2,  Drew  conclusions  in  accordance  with  correct  logical  principlee, 

3,  Presented  results  of  a  check  on  validity  of  conclusions, 

U,  Indicated  correct  interpretation  of  research  results, 

5,  Pointed  out  whether  or  not  the  evidence  was  conclusive, 

6,  Pointed  out  the  limitations  of  data  or  method,  including 

- - i  -ai _ _ _  a.  — 
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Ineffective  Behaviors 

1.  Drew  conclusions  not  supported  by  the  data, 

2,  Presented  a  conclusion  violating  logical  principles, 

3*  Did  not  present  a  check  on  validity  of  conclusions, 

U.  Failed  to  drew  conclusions  from  data  or  tc  show  solution  to 
problem. 

5.  Drew  conclusions  from  incomplete,  inadequate,  or  erroneous  data. 

B,  Pointing  Out  Inplicationa  of  Data 
Effective  Behaviors 

1,  Pointed  out  new  and  useful  isplicationa  of  work, 

2,  Aorked  out  applications  to  other  problems  or  fialds. 
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Ineffective  Behaviors 


1.  Failed  to  report  implications  and  possible  extensions  of  work. 

2*  Pointed  out  implications  which  should  have  been  further  extended. 
3.  Pointed  out  implications  which  were  inapplicable. 

Preparing  Reports 

A.  Describing  and  Illustrating  Work 
Effective  Behaviors 

I*  Pointed  out  important  details  of  procedure  or  results* 

2*  Included  sufficient  detail  to  guide  work  on  similar  problems* 

3*  Kept  statement  of  problem  and  conclusions  brief  enough  for 
quick  grasp* 

iu  Explained  new  material  when  fir3t  introduced. 

5*  Gave  examples  of  practical  applications  or  a  simplified  state¬ 
ment  of  complex  theory* 

6.  Used  graphic,  tabular,  or  pictorial  material  to  clarify  text. 

7*  Defined  all  terms  and  symbols* 

8.  Used  a  simple  system  of  designation  for  items. 

9,  Used  simple,  direct  language  and  concrete  words. 

Ineffective  Behaviors 

1.  Failed  to  state  purpose  of  report  or  project. 

2.  Gave  excessive  detail  in  descriptive  materials. 

3.  Failed  to  emphasize  major  findings  or  overemphasized  unim¬ 
portant  findings. 

U.  Discussed  at  length  elementary  theory  or  well-known  materials, 

5.  Omitted  necessary  illustrative  material. 

6.  Used  inaccurate  labels  on  illustrative  material. 

7.  Gave  inaccurate  references. 

8.  Used  incorrect  or  unorthodox  symbol. 

9.  Presented  ambiguous  definition  of  terms  or  symbols, 

10.  Made  excessive  use  of  complex  sentence  structure  or  unusual 
words* 

11.  Violated  correct  English  usage. 

B*  Substantiating  Procedures  and  Findings 
Effective  Behaviors 

1,  Described  fully  the  basic  principles  involved, 

2,  Descx’ibed  all  significant  elements  of  experiment,  conditions, 
and  results, 

3,  Gave  enough  data  to  permit  reinterpretation  or  checking  of  work. 
U.  Included  detailed  reasoning  leading  to  conclusions  presented, 

5.  explained  the  effect  of  method  used  on  conclusiveness  of  results, 

6.  Gave  explicit  statement  of  underlying  assumptions  and  inferences, 

7.  Presented  logical  explanation  of  unexpected  results. 

6.  Gave  an  especially  complete,  relevant  bibliography. 

Ineffective  Behaviors 

1.  Failed  to  give  sufficient  background  or  theory  for  full 
understanding, 

2.  Failed  to  state  underlying  assumptions, 

3.  Omitted  major  elements  of  work, 

U.  Omitted  details  necessary  for  application  or  checking  of  work, 

5.  Failed  to  give  full  reference  to  related  work. 

6.  Omitted  necessary  bibliography. 

7.  Gave  abstruse  theory  without  presenting  proof, 

8.  Failed  to  give  derivations  of  equations  or  formulas, 

9.  Failed  to  present  material  on  which  conclusions  were  based* 
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G.  Organising  the  Report 
Effective  Behaviors 


1.  Followed  a  logical  outline. 

2.  Gave  problem  and  introductory  material  at  the  beginning 
of  the  report. 

3.  Summarised  the  important  points. 

ii.  Tabulated  data  in  chronological  or  logical  order. 

5.  Presented  conclusions  in  order  of  importance. 

6.  Separated  background  material  or  discussion  from  presentation 
of  method. 

7.  Placed  lengthy  or  detailed  analysis  or  data  in  appendix, 

8.  Placed  references  in  appropriate  location. 

Ineffective  Behaviors 

1*  Failed  to  give  plan  and  scope  of  the  problem  at  the  beginning 
of  the  report. 

2.  Failed  to  bring  out  the  main  points. 

3.  Separated  related  sections  or  materials. 

U«  Jumped  from  one  point  to  another. 

5.  Failed  to  give  cross-index  from  outline  to  details. 

6.  Presented  figures  or  tables  in  order  not  corresponding  to  text, 
7*  Gave  technical  details  in  body  of  report. 

D,  Using  Appropriate  Style  in  Presenting  Report 
Effective  Behaviors 

1,  Used  a  style  adapted  to  audience  or  readers. 

2,  Enunciated  carefully, 

3,  Presented  work  without  undue  apology  or  ostentation. 

lu  Heightened  interest  and  stimulated  thought  by  skillful  man¬ 
ner  of  presentation. 

Ineffective  Behaviors 

1.  Used  "lab  jargon'1  or  unduly  informal  style. 

2.  Represented  sales  rather  than  scientific  viewpoint. 

3.  Had  no  "audience  appeal." 

k •  Spoke  hesitantly  or  with  faulty  delivery, 

VI,  Administering  Research  Projects 

i«  Selecting  and  Training  Personnel 
Effective  Behaviors 

1.  Recruited  personnel  necessary  to  meet  commitments. 

2.  Assigned  worker  a  project  suiting  ability  or  training, 

3.  Gave  constructive  suggestions  to  subordinates. 

It.  Checked  subordinate's  progress  at  critical  points. 

5.  Started  instructional  procedures  for  subordinate. 

6.  Explained  necessary  details  of  project  to  subordinates. 

7.  Made  suggestions  to  subordinates  only  after  learning  details. 
Ineffective  Behaviors 

1.  Assigned  personnel  without  reference  to  their  training  or 
familiarity  with  work, 

2.  Offered  subordinate  no  suggestions, 

3.  Failed  to  discuss  problems  with  subordinate  whan  necessary. 
Failed  to  check  subordinate's  work, 

■5.  Gave  instructions  too  general  to  cover  essontials. 


B«  Dealing  With  Subordinates 

a*  Administering  Reprimands,  Recognition,  and  Praise 
Effective  Behaviors 

1*  Secured  promotion,  recognition,  or  praise  for  deserving 
subordinate, 

2*  Reprimanded  worker  without  disparagement, 

3,  Refused  to  reprimand  worker  without  the  facts, 

U,  Pointed  out  importance  of  their  work  to  subordinates. 
Ineffective  Behaviors 

1,  Reprimanded  a  worker  without  reference  to  facts, 

2,  Failed  to  administer  a  warranted  reprimand. 

3*  Reprimanded  a  worker  in  front  of  associates, 

U«  Upheld  a  worker  without  knowing  facts, 

5,  Failed  to  retract  an  unwarranted  reprimand, 

6,  Disparaged  the  ideas  or  efforts  of  a  subordinate* 

7,  Did  not  introduce  subordinate  to  a  visitor  interested 
in  his  work, 

b.  Looking  Out  for  Subordinates'  Welfare 
Effective  Behaviors 

1,  Arranged  a  schedule  acceptable  to  subordinates. 

Ineffective  Behaviors 

1,  Demanded  unnecessary  hours  or  production, 

2,  Unnecessarily  refused  a  worker  leave, 

c.  Keeping  Subordinates  Informed 
Effective  Behaviors 

1,  Explained  reasons  for  adverse  or  controversial  admini¬ 
strative  action. 

Ineffective  Behaviors 

1,  Did  not  explain  administrative  action  affecting  sub¬ 
ordinates'  work, 

2,  Did  not  inform  subordinates  of  plans  or  decisions. 

d.  Sharing  Responsibility 
Effective  Behaviors 

1,  Discussed  problem  areas  with  subordinates, 

2,  Asked  for  or  accepted  subordinates'  ideas, 

3,  Participated  in  important  phases  of  a  subordinate's  work, 
lu  Delegated  responsibility  for  details, 

5,  Made  only  essential  checks  on  subordinates'  work, 

6,  Supported  considered  decision  of  subordinate. 

Ineffective  Beiiaviors 

1,  Gave  subordinates  no  opportunity  to  present  ideas  at 
planning  conference, 

2,  Failed  to  investigate  or  consider  subordinates'  suggestions, 

3,  Failed  to  participate  in  subordinates'  work, 
h ,  Did  not  delegate  work  or  responsibility, 

5,  Verified  every  detail  of  subordinates'  work, 

6,  Gave  his  own  work  to  subordinates, 

7,  Did  work  with  which  he  was  less  familiar  than  subordinates. 
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C.  Planning  and  Coordinating  the  Work  of  Or o ups 

a.  Selecting  Projects 
Ineffective  Behaviors 

1*  Approved  or  selected  projects  which  could  not  be  iiandled, 

2,  Refused  projects  which  could  be  handled* 

b.  Estimating  and  Supplying  Project  Needs 
Effective  Behaviors 

1*  Outlined  and  scheduled  personnel  needs* 

2*  Scheduled  facilities  and  equipment  for  use  by  several  groups* 

3*  Had  supplies  available  when  needed* 

li*  Developed  a  system  facilitating  procurement  of  supplies. 

5*  Went  outside  of  usual  supply  channels  when  necessary* 

6*  Ordered  supplies  from  most  economical  source* 

Ineffective  Behaviors 

1*  Submitted  plans  with  vague  steps  and  time  estimates* 

2*  Made  erroneous  estimate  of  personnel  needs* 

3*  Failed  to  request  facilities  via  proper  channels. 

U*  Failed  to  reorder  stock  in  time  for  use* 

c.  Organising  the  Work  of  Projects 
Effective  Behaviors 

It  Assigned  homogeneous  units  of  work  to  groups. 

2*  Suggested  changes  in  method  which  facilitated  work* 

3*  Simplified  or  standardized  routine  procedure* 

Ineffective  Behaviors 

1*  Assigned  no  problems  to  group. 

2*  Delayed  making  assignments. 

3*  Oave  high  priority  to  a  minor  task, 

lu  Assigned  personnel  to  one  project  at  expense  of  another. 

5*  Failed  to  designate  supervisor  for  project. 

d.  Unifying  Related  Groups 
Effective  Behaviors 

1*  Froposed  consolidation  of  related  projects  into  unified 
program* 

2.  Eliminated  or  reduced  overlapping  and  duplication  between 
groups. 

Ineffective  Behaviors 

1*  Failed  to  coordinate  related  projects, 

D*  Making  Administrative  Decisions 
a*  Making  Needed  Decisions 
Effective  Behaviors 

1*  Made  decision  arid  issued  instructions  promptly  in  emergency* 
Ineffective  Behaviors 

1.  Delayed  making  a  needed  decision. 

2,  Failed  to  make  a  decision  which  was  his  responsibility, 

3*  Revised  a  decision  without  improving  it. 


b.  Following  Regulations  in  Decisions 
Effective  Behaviors 


1.  Deviated  from  standard  administrative  procedure  to 
handle  emergency. 

Ineffective  Behaviors 

1.  Took  administrative  action  inconsistent  with  agency  policy* 

2.  Deviated  from  standard  procedure  in  non-emergency  situation* 

3.  Went  outside  of  regular  channels  to  solicit  favorable 
decision* 

U.  Refused  to  make  an  exception  to  regulation  when  situation 
demanded  it. 

c.  Basing  Decisions  on  Facts 
Effective  Behaviors 

1.  Decided  only  after  gathering  all  pertinent  facts. 

2.  Gave  out  information  only  after  checking  facts. 

Ineffective  Behaviors 

1.  Announced  decision  before  studying  evidence. 

2.  Gave  out  information  before  checking  facts. 

3.  Based  decision  on  ideas  of  personnel  unfamiliar  with 
problem. 

E.  Working  With  Other  Groups 
Effective  Behaviors 

1.  Obtained  cooperation  or  action  essential  to  project. 

2.  Got  opposing  groups  to  agree.  * 

3.  Pointed  out  mutual  problems  of  groups. 

U.  Expedited  joint  project  independently  without  offanding 
cooperating  group. 

5.  Checked  closely  on  work  being  done  by  another  group. 
Ineffective  Behaviors 

1.  Failed  to  get  action  from  cooperating  group. 

2.  Antagonized  members  of  cooperating  group. 

3.  Failed  to  request  action  from  another  administrative 
level  on  vital  issue, 

k»  Failed  to  inform  cooperating  groups  of  decisions  or 
actions  affecting  their  work. 

5.  Neglected  to  make  personal  contacts  essential  to  progress 
of  project. 

6.  Refused  to  lend  related  groups  equipment  or  supplies, 

VII.  Accepting  Organizational  Responsibility 
A.  Performing  Own  Work 

a.  Doing  Work  Promptly 
Effective  Behaviors 

1,  Completed  difficult  or  extensive  assignment  on  schedule 
without  omitting  essential  checks  on  quality  of  work. 

2,  Started  work  as  soon  after  receiving  assignment  as 
priority  permitted, 

3,  Began  to  v.ork  directly  on  the  probleu  after  only  a 
necessary  amount  of  preliminary  study  and  exploration. 
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Ineffective  Behaviors 


1.  Did  not  complete  assigned  job  in  time  a  .lotted# 

2.  Put  work  aside  after  receiving  assignment  though  he  had 
no  other  pressing  work* 

3.  Failed  to  prepare  for  an  important  step  until  the  last 
minute,  resulting  in  inadequate  preparations* 

U.  Failed  to  write  report  of  project  urtil  prodded. 

b.  Accepting  Responsibility  for  Own  Work 

Effective  Behaviors 

1.  Completed  a  difficult  assignment  without  supervision  or  help. 

Ineffective  Behaviors 

1.  Asked  others  to  solve  a  problem  or  indicated  unwillingness 
to  undertake  a  problem  which  was  his  responsibility. 

2.  Asked  others  to  help  on  an  unformulated  problem* 

3.  Stated  that  an  assigned  job  couldn't  be  successfully 
done,  and  spent  a  good  deal  of  time  expounding  on  its 
difficulties, 

U.  Left  incomplete  work  in  such  condition  that  others  could 
not  complete  it. 

o.  Allocating  Own  time  and  Effort 

Effective  Behaviors 

1.  Proceeded  to  next.  stap  of  project  without  waiting  to  be  told. 

2.  Outlined  a  plan  for  solving  a  new  problem  on  his  own 
initiative* 

3.  Took  on  an  additional  duty  voluntarily. 

U*  Organized  rork  to  permit  carrying  out  several  different 
tasks  concurrent  y. 

Ineffective  Behaviors 

1.  Did  not  go  beyond  carrying  out  specific  instructions 
even  though  next  step  needed  doing. 

2.  Stoppec.  work  when  preliminary  results  were  obtained, 
failing  to  completely  finish  the  job. 

3.  Spent  time  doing  more  work  on  an  assignment  than  desirable 
considering  the  nature  of  the  assignment. 

U.  Got  side- tracked  on  irrelevant  details. 

5.  Dissipated  efforts  over  several  problems  in  different  fields. 

B.  Assisting  in  the  i7ork  of  Others 

Effective  Behaviors 

1.  Passed  on  a  successful  technique  or  finding  to  others, 

2.  Offered  information,  assistance,  or  suggestions  to  other 
workers. 

3»  Kept  interested  persons  and  groups  fully  informed  on  pro¬ 
gress  of  project. 

U.  Reported  progress  with  written  reports  requiring  minimum 
of  superior's  time, 

5.  Consulted  supervisor  about  usefulness  of  an  original  idea. 

6,  Pointed  out  inadequacies  of  a  plan,  regulation,  or. policy 
to  group  responsible  for  it. 

Ineffective  Behaviors 

1*  Neglected  to  pass  on  an  important  finding  to  others. 

2.  Fa.  led  to  provide  information  or  assistance  requested 
by  workers  on  related  projects. 

Criticized  work  of  others  without  making  suggestions 
for  improvement. 


C*  Subordinating  Personal  Interests 
Effective  Behaviors 


( 
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1.  Pursued  main  problem  without  being  side-tracked  by  personal 

interests  in  other  work*  1 

2,  Dropped  major  interest  to  study  less  interesting  project 
more  closely  related  to  goal* 

3*  Accepted  necessary  reduction  in  scope,  personnel}  or 
facilities  of  his  program* 

1*.  Maintained  own  morale  and  efficiency  or  that  of  subordinates 
in  the  face  of  difficulties* 

Ineffective  Behaviors 

1*  Worked  on  problems  interesting  to  him  but  not  directly  related 
to  assigned  work* 

2*  Digressed  or  discussed  irrelevant  details  in  a  conference* 

3*  Objected  to  necessary  reduction  in  scope}  personnel}  or 
facilities  of  his  program* 

U*  Refused  to  work  on  a  project  unless  given  desired  type  of 
work}  or  a  salary  increase* 

5*  Requested  that  work  of  others  be  rearranged  to  conform  with 
own  plans  or  ideas. 

6.  Gave  orders  tc  personnel  over  whom  he  had  no  authority* 

D*  Accepting  Regulations  and  Supervision 
Effective  Behaviors 

1*  Requested  clarification  of  assignment  when  in  doubt* 

2*  Solicited  aid  from  superior  when  faced  with  difficulties* 

3*  Reported  progress  and  probable  delays  to  superior* 

Ineffective  Behaviors 

1.  Failed  to  ask  for  clarification  of  instructions  until  he 
made  a  mistake* 

2*  Failed  to  request  aid  when  needed* 

3*  Failed  to  report  progress  or  delay  to  superior. 

U,  Instituted  changes  in  procedures  without  consulting  superior* 

5*  Accepted  an  impossible  assignment  without  question. 

6.  Failed  to  comply  with  a  regulation,  order,  or  instruction. 

7.  Insisted  that  regulations  be  waived  in  his  case. 

VIII*  Accepting  Personal  Responsibility 
A*  Adapting  to  Associates 
Effective  Behaviors 

1*  Criticized  the  work  of  another  without  disparaging  his  efforts. 

2.  Oave  specific  answers  to  questions  of  others. 

Ineffective  Behaviors 

1*  Made  disparaging  remarks  about  others  or  their  work* 

2*  Gave  vague  answers  to  questions  of  others* 

3.  Criticized  work  of  others  without  studying  it  carefully, 

U.  Quarrelled  with  or  spoke  rudely  to  other  staff  members* 

5*  Interrupted  work  of  others  to  discuss  personal  or  irrelevant 
matters. 
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B,  Adapting  to  Job  Demands 
Effective  Behaviors 


1.  Accepted  the  suggestions  and  advice  of  a  supervisor  or  other 
expert  gladly. 

2.  Continued  to  work  according  to  plan  in  spite  of  obstacles  or 
opposition. 

3.  Completed  work  even  though  assigned  to  job  distasteful  to  him, 
b,  Worked  overtime  to  meet  a  deadline. 

5.  Performed  work  normally  delegated  to  others  in  order  to  avoid 
delay. 

Ineffective  Behaviors 

1.  Refused  to  accept  criticism  or  advice. 

2.  Slowed  up  or  abandoned  project  when  faced  with  obstacles  or 
opposition. 

3.  Failed  to  turn  out  work  when  assigned  to  job  distasteful  to  him. 

U.  Refused  to  work  overtime  to  meet  a  deadline. 

5.  Requested  leave  during  peak  work  period. 

6.  Decreased  efforts  after  unwanted  change  in  job-status  or  work- 
situation. 

7.  Was  absent  from  work  without  legitimate  reason. 

8.  Refused  to  give  up  a  project  in  spits  of  evidence  proving  it 
to  be  useless. 

C.  Meeting  Personal  Commitments 
Ineffective  Behaviors 

1.  Failed  to  perform  a  specifically  assigned  task  to  which  he  had 
agreed. 

2.  Performed  an  assignment  in  a  way  different  from  that  agreed  upon. 

3.  Failed  to  report  for  an  important  appointment  or  conference. 

D.  Being  Fair  and  Ethical 
Effective  Behaviors 

1.  Presented  favorable  and  unfavorable  evidence  in  reporting 
results  or  making  recommendations. 

2.  Cave  credit  for  ideas  or  work  to  those  responsible. 

3.  Reported  his  conclusions  despite  possible  jeopardy  to  position. 
Ineffective  Behaviors 

1.  Deleted  or  glossed  over  evidence  which  would  have  revealed 
errors,  omissions,  or  unfavorable  conclusions, 

2.  Failed  to  give  credit  for  ideas  or  work  of  others. 

3.  Substituted  his  work  for  that  of  others  without  their  consent. 

U.  Falsified  data. 

5.  Blamed  others  or  made  excuses  for  his  own  errors  or  failures. 

6.  Argued  that  wrong  action  was  acceptable. 

7.  Made  untrue  statements  about  work  or  its  progress, 

6.  Made  false  charges  against  another. 

E.  Showing  Interest  in  Work 
Effective  Behaviors 

1.  Worked  on  own  time  to  improve  technical  knowledge  and  proficiency, 

2.  Suggested  that  he  take  a  special  training  course  applicable 
to  his  assignment. 

3.  Discussed  ideas  and  plans  for  project  enthusiastically. 

U.  Asked  subordinates  to  educate  him  by  explaining  their  work 
in  detail. 

Ineffective  Behaviors 

1.  Turned  down  an  offer  to  study  on  government  time, 

2.  Devoted  time  on  the  job  to  social  visiting  or  to  personal  work, 

3.  Showed  little  enthusiasm  in  discussing  plans  for  project, 
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Appendix  III 


RATIONALES  RELATING  TYPES  OF  TEST  ITEMS  TO  TOE  CRITICAL  BEHAVIORS 


Appendix  III  contains  "rationales"  relating  types  of  test  items 
to  the  specific  critical  behaviors  they  were  designed  to  predict. 
The  r« tionales  are  presented  here  to  illustrate  the  general  types 
of  items  developed.  It  is  also  believed  that  the  rationales  may 
be  of  interest  to  others  concerned  with  the  development  of  meas¬ 
ures  of  scientific  aptitude. 

The  rationales  are  presented  in  an  outline  form  corresponding  to 
that  used  in  the  list  of  critical  requirements.  Each  rationale 
contains!  (1)  a  statement  of  the  major  area  (Roman  numeral), 
subarea  (capital  letter),  and  critical  benavior  (arable  numeral) 
concerned;  (2)  a  statement  of  hypotheses  as  to  the  knowledges, 
abilities,  or  personality  traits  believed  to  underlie  that  criti¬ 
cal  behavior,  under  the  heading,  "This  behavior  seems  to  involve"; 
(3)  a  description  of  the  type  of  test  item  it  is  believed  would 
appropriately  sample  these  knowledges,  abilities,  or  traits,  under 
the  heading,  "An  item  intended  to  predict  this  behavior."  More 
than  one  type  of  test  item  is  suggested  for  some  critical  behaviors 
In  a  few  cases  types  of  test  items  are  suggested  for  a  group  of 
critical  behaviors  (subarea)  and  the  rationale  then  presents  an 
analysis  of  the  subarea. 
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RATIONALES  RELATING  TYPES  OF  TEST  ITEMS 
TO  THE  CRITICAL  BEHAVIORS 


Ia  Formulating  Problems  end  Hypotheses 
A*  Identifying  and  Exploring  Problems 

2.  INVESTIGATED  UNEXPECTED  RESULTS  OR  DIFFICULTIES 
ENCuuNiERED  IN  wuRK. 

This  behavior  seems  to  involve: 

(1)  Knowing  what  to  expect  from  a  particular  set  of  conditions 

(2)  The  ability  to  recognize  that  results  found  present  a  diffi¬ 
culty 

(3)  The  ability  to  recognize  that  the  difficulty  calls  for  some 
investigative  action 

(4)  The  ability  to  develop  hypotheses  that  might  account  for 
this  difficulty 

(5)  The  ability  to  evaluate  these  hypotheses  and  select  the  one 
potentially  most  fruitful  for  investigation 

(6)  Technical  know-how  and  other  skills  to  investigate  the 
hypothesis 

An  item  intended  to  predict  this  behavior: 

Present  a  diagram  of  a  heating  system  with  some  inconsistent  data 
concerning  it  ud  list  five  aspects  of  the  data  idiich  might  reflect  a 
difficulty.  The  examinee  is  asked  to  select  that  aspect  which  requires 
investigation.  This  should  sample  (1),  (2),  and  (3)  above. 

Describe  a  situation  which  suggests  that  certain  data  need  further 
investigation  and  list  five  possible  methods  of  gaining  information 
that  night  resolve  the  difficulty.  The  examines  is  asked  to  select 
the  most  promising  procedure,  lids  should  scmple  (3),  (4) f  and  (5) 
above. 


I.  Fdnaulatlng  Problem?!  and  Hypotheses 
A,  Identifying  and  Exploring  Problems 

4,  SUGGESTED  A  NEW  PROELtti  WHICH  COULD  BE  STUDIED  WITH  hN 
ALREADY  SUCCSSoFUL  TEClQ.IwUE. 


This  behavior  seems  to  involve: 

(1)  Farlllarity  with  a  technique  that  has  already  been  used 
successfully 

(2)  'Tie  ability  to  abstract  a  class  of  problems  whose  require¬ 
ments  would  be  fulfilled  by  that  technique 

(3)  The  ability  to  select  one  problem  from  that  class 

An  item  intended  to  predict  this  behavior: 

Describe  a  technique  that  has  been  used  successfully  and  list 
several  problems*  The  examinee  is  asked  to  select  the  problem  for 
which  ti»  technique  probeoly  has  most  value.  This  should  saaple 
(2)  and  (3)  above. 
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I.  Formulating  Problem#  and  Hypotheses 
B,  Defining  the  Problem 

3.  GaTHERcJ  INFoRuiTIOii  ON  rXiGT  RETIREMENTS,  SPECIFICATIONS 
AND  GOAL  OF  hSoIGHED  PROJECT. 

This  behavior  seems  to  involve: 

(1)  Recognising  the  importance  of  gathering  information 

(2)  Identifying  information  required  by  problem 

(3)  Taking  steps  to  gather  information 

(4)  Taking  these  steps  in  proper  order 

An  item  intended  to  predict  this  behavior: 

Describe  a  problem,  present  five  elements  of  information  that 
solution  of  problem  may  require,  and  a3k  examinee  to  select  the  one 
that  uould  logically  be  sought  first.  This  should  sample  (4)  above. 

Present  a  descriotion  of  a  problem  and  liut  five  possible  ways 
to  befin  solution  of  the  problem.  The  examinee  must  select  an  es¬ 
sential  step  that  must  be  taken  first.  This  should  sample  (2)  and 
(4)  above. 

Describe  a  planning  conference  that  proved  unproductive  and 
list  five  possible  criticisms  cf  the  session.  The  examinee  is 
asked  to  recognize  the  need  for  more  information  in  selecting  the 
moct  important  criticism  of  the  session.  This  should  sample  (l) 
and  (2)  above. 


I,  Foraulating  Probleme  and  Hypotheses 
C.  Setting  up  Hypotheses 

1.  PrtOPOCiD  hlXBtSlS  OR  GeJCiuJ.  r'O.tfUU  IN  ORD^R  TO 
EXPLAIN  CBS-RVLD  PHEiJCfeiNA. 


This  behavior  seeme  to  involve: 

0)  The  ability  to  think  of  potential  explanations  of  an 
observed  event 

(2)  The  ability  to  evaluate  the  explanations 
(j)  The  ability  to  rut  the  explanations  in  order  of  orord.se 
or  practicability 

.4*1  item  intended  to  predict  this  behavior: 

Present  a  description  of  an  observed  event  and  li3t  five  ex¬ 
planatory  hyretheses,  one  of  i4rich  is  considerably  lean  probable 
than  the  ethers,  and  raouire  the  exarince  to  select  the  least 
premia  in  *  '.r  puthesio;  or  present  one  promising  and  four  poor  hy- 
*x)the?ca,  repairing  that  the  beot  be  selected,  buch  an  item  vould 
require  the  exrainee  to  perform  steps  (2)  and  (3)  above. 


I.  Formulating  Problems  and  Hypotheses 
C.  Sitting  Up  Hypotheses 

2.  rEEDICIED  PIENQMSNa  iff  THEOKETIC.iL  OR  IuTHEKaTICaL 
ANALYSIS. 

This  behavior  seams  to  involve? 

(1)  Searching  for  patterns  or  relationships  in  data 

(2)  Developing  or  selecting  a  theoretical  or  mathematical 
analysis  to  account  for  the  observed  relationship(s) 

(3)  Making  a  prediction  on  the  basis  of  (2) 

An  item  intended  to  predict  this  behavior: 

Describe  a  relationship  in  a  set  of  data  and  present  a  mathe¬ 
matical  analysis  that  would  account  for  the  observed  relations'-ip. 
The  examinee  is  asked  to  select  from  a  list  of  predictions,  the 
prediction  that  would  follow  from  (2)  above.  This  seen®  to  saa^le 
(3)  above. 


II.  Planning  and  Deeigning  the  Investigation 
A.  Collecting  Background  Information 

1.  SOUGHT  OUT  IiiFCRhATlOii  a!1D  InEAS  FRCM  EXISTING  LIT¬ 
ERATURE,  nSSOCLiTES,  OR  EXPERTS  ON  PROSLEi-.  BEFORE 
EEGINNING  WORK  ON  PROJECT. 

This  behavior  seems  to  involve: 

(1)  Understanding  that  litorature,  associates,  and  experts 
may  supply  information  that  allows  unnecessary  work  and 
errors  to  be  avoided 

(2)  Understanding  that  the  sooner  these  sources  are  consulted, 
the  less  unnecessary  work  will  be  done  and  the  fewer 
errors  coaaitted 

An  item  intended  to  predict  this  behavie": 

Describe  a  specific  technical  task  to  be  performed.  Indicate 
that  the  person  who  is  to  perform  the  task  is  unfamiliar  with  it. 

As  alternatives  offer  various  ways  to  begin  work  on  the  problem. 
Examinee  is  retired  to  select  consulting  literature  as  preferable. 
This  should  sample  (l)  and  (2)  above. 


II,  Planning  and  Desigrdng  the  Investigation 
A.  Collecting  Background  Information 

2,  INCLUDED  ALL  RELENT  SO.' REES  IN  SURVEYING  LITrELiTURE 
CR  CGfCULIING  c^PELTS. 


This  behavior  seams  to  involve: 

(1)  Recognition  that  as  many  relevant  sources  of  information 
should  be  consulted  as  possible 

(2)  The  ability  to  think  of  sources  relevant  in  a  specific 
situation 
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An  item  intended  to  predict  this  behaviors 

Describe  a  long  research  project  and  the  steps  taken  to  secure 
background  information,  A  list  of  deficiencies  in  the  work  of  the 
project  is  given  and  the  examinee  must  recognize  that  all  xelevant 
sources  were  not  consulted.  This  samples  (l)  and  (2)  above. 


II,  Planning  and  Designing  the  Investigation 
A,  Collecting  Background  Information 

3.  QUESTIONED  THE  VALIDITY  OF  MATERIAL  IN  THE  LITERATURE. 

This  behavior  seems  to  involve; 

(1)  An  objective  attitude  toward  reported  findings 

(2)  Professional  acumen  sufficient  to  provide  o  background 
against  which  to  consider  material  reported  in  the 
literature 

(3)  The  ability  to  weight  appropriately  the  confidence  to  be 
placed  in  reported  results  and  the  expectations  with  which 
they  are  at  vaiiance 

An  item  intended  to  predict  thi3  behavior: 

Present  a  set  of  data  from  a  very  reliable  source  and  also 
present  very  strong  evidence  that  there  is  an  obvious  error  in  one 
datum.  The  examinee  must  recognize  that  the  usually  reliable  source 
is  not  infallible  and  is  probably  in  error  in  tide  case.  Has 
should  sample  (l),  (2),  and  (3)  above. 


II,  Planning  and  Designing  the  Investigation 
A.  Collecting  Background  Information 

7.  PERFOWiED  EXPERMiT  OR  (kTHiiHmd  NRCEESaRY  INFORMATION 
DIRECTLY  WHICH  UAS  UNAVAILABLE  IN  USUAL  SOURCES. 


This  behavior  seems  to  involve; 

(1)  A  strong  and  continuing  desire  to  complete  an  assignment 
such  as  obtaining  necessary  information 

(2)  A  realization  that  consulting  very  unlikely  sources  may 

be  less  profitable  than  performing  the  necessary  operations 
for  obtaining  the  information  directly 

(3)  A  willingness  to  perform  necessary  operations  for  obtain¬ 
ing  information 

(4)  The  ability  to  perform  necessary  operations  for  obtain¬ 
ing  information 

An  item  intended  to  predict  this  behavior; 

Specify  a  task  of  obtaining  information  and  indicate  that  the 
usual  sources  have  been  consulted  without  success.  List  five 
possible  steps  that  might  be  taken  at  that  point.  The  examinee 
is  asked  to  select  a  direct  method  of  obtaining  the  information 
rather  than  either  an  indirect  method  or  discontinuation  of  at¬ 
tempts  at  solution*  This  should  sample  (l)  and  (2)  above. 
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II.  Planning  and  Designing  the  Investigation 
B.  SETTING  UP  ASSUMPTIONS 

This  behavior  seems  to  involve: 

(1)  The  ability  to  formulate  assumptions  appropriate  to  the 
problem 

(2)  The  ability  to  examine  assumptions  critically 

(3)  The  ability  to  select  assumptions  appropriate  to  the  prob¬ 
lem  on  the  basis  of  (2) 

An  item  intended  to  predict  this  behavior: 

Describe  an  experimental  design  and  list  five  possible  assump¬ 
tions,,  Ask  the  examinee  to  select  the  assumption  in  the  list  that 
is  necessary  to  the  design.  This  should  sample  (2)  and  (3). 


II*  Planning  and  Designing  the  Investigation 

C.  Identifying  and  Controlling  Important  Variables 
1.  OUTLINED  PLAN  PERMITTING  CONTROL  AND  SYSTEMATIC 
VARIATION  OF  ALL  RELEVANT  VARIABLES. 

This  behavior  seems  to  involve: 

(1)  The  ability  to  recognize  relevant  variables 

(2)  The  ability  to  decide  which  variables  must  be  controlled 
in  order  to  test  a  hypothesis  adequately 

(3)  The  ability  to  devise  methods  to  control  the  variables 
selected  in  (2) 

(4)  The  ability  to  integrate  the  materials  in  the  development 
of  a  plan 

An  item  intended  to  predict  this  behavior: 

Describe  an  experiment  where  a 13  relevant  variables  are  not 
properly  controlled*  Present  five  alternatives  offering  different 
experimental  designs,  the  correct  choice  being  the  one  which  best 
controls  relevant  variables.  Ask  the  examinee  to  select  the  best 
plan;  in  doing  so  he  must,  in  part,  perform  steps  (l),  (2),  and  (3)* 

Describe  an  experimental  problem  and  list  five  possible  plans 
for  solving  the  problem.  The  examinee  is  asked  to  select  the  best 
design.  This  seems  to  sample  (l)  and  (2)  above. 

Present  a  research  problem  and  an  outline  of  the  planned  steps. 
List  five  3teps  included  and  ask  the  examinee  to  se].ect  the  step 
which  is  an  example  of  good  control  of  the  variable"-.  Or,  list  five 
steps  and  ask  the  examinee  to  select  the  step  which  is  an  example 
of  poor  control  of  the  variables.  This  indirectly  samples  (l),  (2), 
(3),  and  (4)  above. 
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II,  Planning  and  Designing  the  Investigation 

C,  Identifying  and  Controlling  Important  Variables 

3.  SIUJUTED  ACTUAL  CONDITIONS  In  A  LABORATORY  TEST 

This  behavior  seems  to  involve i 

(1)  Understanding  of  actual  conditions 

(2)  Knowledge  of  laboratory  facilities 

(3)  Appreciation  of  which  conditions  are  important  variables 
and  wliich  are  not 

(4)  Use  of  (2)  to  reproduce  important  conditions  (3)  in  ex¬ 
periment 

(5)  Organization  of  variables  so  that  they  may  interact  in 
all  the  ways  they  do  under  actual  conditions 

An  item  intended  to  predict  this  behavior: 

Describe  a  testing  problem  in  a  laboratory  situation.  List 
five  plans  to  test  the  material.  The  examinee  is  asked  to  select 
the  plan  which  most  closely  simulates  actual  conditions.  Ibis 
should  sample  (l),  (3),  (4),  and  (5)  in  part. 

Present  a  research  problem  and  an  outline  of  the  planned  etepe. 
List  five  possible  improvements  of  one  step  in  the  outline.  Hie 
examinee  is  asked  to  select  the  best  improvement.  This  should 
sample  (3)  and  (3)  above. 


II,  Planning  and  Designing  the  Investigation 

C,  Identifying  and  Controlling  Important  Variables 

4.  DESCRIBED  OR  OUTLINED  PLANS  IK  WHICH  THE  VARIOUS 

Factors  were  treated  in  accordance  with  their  relative 
Ii  PORTaNCE, 

This  behavior  seens  to  involve: 

(1)  Selecting  experimental  variables  relevant  to  the  problem 

(2)  Judging  their  relative  importance  ae  related  to  criteria 
such  as  purpose  of  the  investigation  and  practical  ap¬ 
plications  to  be  made  of  results 

(3)  Preparing  a  plan  for  the  investigation  that  allots  amount 
and  type  of  data  to  be  gathered  for  each  variable  in  pro¬ 
portion  to  the  judgments  of  importance  made  under  (2) 

An  item  intended  to  predict  this  behavior: 

Present  a  research  problem  and  an  outline  of  the  planned  steps. 
List  five  of  the  steps  and  ask  the  examinee  to  select  the  step  which 
reflects  the  most  basic  error  in  the  design  of  the  problem.  This 
should  sample  (l),  (2),  and  (3)  above. 

Present  the  details  of  a  research  problem  and  list  five  rele¬ 
vant  variables.  Ask  the  examinee  to  select  the  variable  that  ie 
most  likely  to  affect  the  outcome  of  the  study.  This  should  sample 
(2)  above. 
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II.  Planning  and  Designing  the  Investigation 

C.  Identifying  and  Controlling  Important  Variables 

5.  POINTED  OUT  THE  SIGNIFICANCE  OF  a  FaCIOR  OVERLOOKED 
OR  DISMISSED  aS  TRIVIAL  BY  OTHERS. 

lhis  behavior  seems  to  involves 

(1)  An  attitude  that  is  critical  of  material  until  sufficient 
work  has  been  done  on  it 

(2)  The  ability  to  recognize  what  factors  would  have  a  signi¬ 
ficant  effect  on  results 

An  item  intended  to  predict  this  behaviors 

Describe  an  experimental  design  containing  a  critical  uncon¬ 
trolled  variable  and  ask  the  examinee  to  discriminate  that  variable 
from  1638  important  variables.  This  should  sample  (2)  above. 

Describe  an  experimental  design  containing  a  critical  uncon¬ 
trolled  variable  and  list  five  criticisms  of  the  design.  Ask  the 
examinee  to  select  the  most  important  criticism  of  the  design. 

This  should  sample  (2)  above. 


II.  Planning  and  Designing  the  Investigation 

D,  Developing  Systematic  and  Inclusive  Plans 

1.  (Ineffective)  OMITTED  A  RELEVANT  FACTOR  OR  PHaSE  IN 
OUTLINING  PLANS  FOR  AN  INVESTIGATION. 

This  behavior  seems  to  involve: 

(1)  Carelessness  in  outlining  plans  although  being  aware  of 
relevant  factors  and/or, 

(2)  Failure  to  recognize  relevance  of  factors  or  phases  and/or, 

(3)  Failure  to  consider  relevant  factors  or  phases  and, 

(A)  Inability  or  failure  to  review  proposed  plans  critically. 

An  item  intended  to  predict  this  behavior: 

Present  a  set  of  instructions  for  the  preparation  of  a  chemi¬ 
cal  compound  and  list  five  necessary  items  for  making  the  compound. 
The  examinee  is  asked  to  select  that  item  which  is  nov  sufficiently 
specific  to  prepare  the  compound.  This  should  sample  (2)  and/or 

(3)  above. 


II,  Planning  and  Designing  the  Investigation 

D,  Developing  Systematic  and  Inclusive  Plane 

3,  POINTED  OUT  THE  RaSIC  FaCTCRS  IN  A  MASS  OF  INFORMATION 
ABOUT  THE  PROBLEM. 

This  behavior  seems  to  involve: 

(1)  The  ability  to  formulate  clearly  the  problem  for  which 
information  is  needed 

(2)  The  ability  to  Judge  the  relevance  of  available  informa¬ 
tion  to  the  problem  and  to  select  the  basic  factors 
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An  item  intended  to  predict  this  behavior: 

Present  a  situation  in  which  a  described  report  must  be  written 
and  list  five  subjects  for  inclusion  in  the  report.  Ask  the  ex¬ 
aminee  to  select  the  least  useful  subject.  This  should  sample  (1) 
and  (2)  above. 


II,  Planning  and  Designing  the  Investigation 

D,  Developing  Systematic  and  Inclusive  Plana 

5.  outlined  PLiU  calling  for  uch  element  of  problem  to  be 

STUDIED  IN  SEQUENCE. 

This  behavior  seems  to  involve: 

(1)  Knowing  or  developing  a  definition  of  the  problem 

(2)  Selecting  or  developing  a  method  appropriate  to  the  problem 

(3)  Outlining  in  detail  steps  involved  in  the  method 
(/.)  Selecting  the  appropriate  first  step 

An  item  intended  to  predict  this  behavior: 

Describe  a  problem  and  offer  as  alternatives,  steps  that  might 
be  taken  in  various  procedures.  The  examinee  must  select  the  step 
that  would  come  first  in  the  most  appropriate  method.  'Hds  should 
sample  (2)  and  (uT, 


II,  Planning  and  Designing  the  Investigation 

E.  Developing  Plans  for  the  Use  of  Equipment,  Materials,  or 
Techniques 

1,  INCLUDED  IN  PUN  OF  IWUTIGaTIoN  EQUIPMENT,  MATERIAL, 

OR  TECHNIQUES  NHICK  MET  THE  IU.UIREf.ENT5  OF  THE  PROBLEM. 

This  behavior  seems  to  involve: 

(1)  Identification  of  the  requirements  of  the  problem 

(2)  The  ability  to  relate  pertinent  characteristics  of  equipment, 
material,  cr  techniques  to  the  problem 

(3)  The  ability  to  evaluate  these  characteristics  and  to  select 
those  procedures  that  will  best  fulfill  the  requirements  of 
the  problem 

An  item  intended  to  predict  this  behavior: 

Describe  a  niece  of  equipment  that  does  not  meet  certain  specified 
requirements,  list  five  possible  ways  of  correcting  the  equipment  in 
order  to  meet  these  requirements.  The  examinee  aust  select  the  most 
satisfactory  way  to  change  the  equipment  or,  ask  the  examinee  to  se¬ 
lect  the  least  satisfactory  change.  This  should  sample  (2)  and  (3) 
above. 

Describe  the  requirements  of  a  problem  and  ask  the  examinee  to 
select  tho  tooted  que  that  would  twst  fulfill  them.  Thia  should  sample 
(2)  and  (3)  above. 
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Describe  a  problem  without  making  explicit  its  requirements.  List 
five  techniques  that  might  resolve  the  problem  and  ask  the  examinee 
to  select  the  best  technique.  Or,  ask  the  examinee  to  select  the 
least  useful  technique.  This  should  sample  (1),  (2),  and  (3)  above. 


II,  Planning  and  Designing  the  Investigation 

E,  Developing  Plans  for  the  Use  cf  Equipment,  Materials,  or 
Technique* 

2.  CHOSE  A  SU'tPLIFIED  TECHNIQUE  HUT  PRODUCED  RESULTS  CP 
REQUIRED  STANDARDS. 

This  behavior  seems  to  involve: 

The  ability  to  identify  the  standard  required 
Knowledge  of  several  techniques  that  may  or  may  not  result 
in  meeting  the  standard 

The  ability  to  evaluate  (2)  and  to  select  the  simplest  tech¬ 
nique  that  meets  the  standard 

An  item  intended  to  predict  this  behavior: 

Present  a  description  of  a  problem  and  list  five  possible  tech¬ 
niques  to  use  in  its  solution.  The  examinee  is  asked  to  select  the 
technique  that  is  the  simplest  one  that  meets  the  standard.  This 
seems  to  sample  (l)  and  (3)  above. 


II.  Planning  and  Designing  the  Investigation 

E.  Developing  Plans  for  the  Uae  of  Equipment,  Materials,  or 
Techniques 

2.  (Ineffective)  PLANNED  ID  USE  E^UIPnENT  OR  MATERIALS 
MORE  C08PUEX  OR  EXPENSIVE  TI.aN  ikCESoaRY  TO  PRODUCE 
RESULTS  OF  REQUIRED  SThNDaRDS. 

This  behavior  seems  to  involve: 

(1)  Lack  of  familiarity  with  existing  equipment,  materials,  or 
techniques,  and/or 

(2)  Inability  to  evaluate  these  on  the  basis  ->f  cost  or  complex¬ 
ity,  and/or 

(3)  Failure  to  adapt  equipment,  materials,  or  techniques  that 
are  least  expensive  or  most  simple 

An  item  Intended  to  predict  this  behavior: 

Present  a  diagram  and  description  of  an  apparatus  that  is  more 
complex  or  expensive  than  necessary  for  the  specified  standards. 

List  five  possible  criticisms  of  the  apparatus  and  ask  the  examinee 
to  select  the  most  pertinent  criticism.  This  should  sample  (2)  above. 
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II*  Planning  and  Designing  the  Investigation 

E,  Developing  Plans  for  the  Use  of  Equipment,  Materials,  or 
Techniques 

5.  PLANNED  TO  USE  TECHNIQUE  OR  EQUIPMENT  THAT  WOULD  ELIMINATE 
DOUBT  CP  VALIDITY  OR  ACCURiCY  OF  RESULTS. 

This  behavior  seems  to  involve: 

(1)  Concern  for  validity  or  accuracy  of  results 

(2)  Tha  ability  to  formulate  the  requirements  of  a  problem  that 
must  be  fulfilled  in  order  to  obtain  valid  or  accurate  results 

(3)  the  ability  to  devise  or  select  techniques  or  equipment  that 
will  eliminate  doubt  of  validity  or  accuracy 

An  item  intended  to  predict  this  behavior: 

Describe  five  instruments  and  their  limits  of  accuracy.  The  ex¬ 
aminee  is  asked  to  select  the  instrument  that  is  mc3t  accurate,  This 
seems  to  sample  (3)  above. 

Present  a  research  problem  and  an  outline  of  its  planned  steps. 

Ask  the  examinee  to  select  the  best  substitute  for  an  inadequate  step, 

II,  Planning  and  Designing  the  Investigation 

E.  Developing  Plans  for  the  Use  of  Equipment,  Materials,  or 
Techniques 

7,  CONDUCTED  PILOT  STUDY  TO  DETERMINE  FEASIBILITY  OF  PRO¬ 
POSED  techniques ,  materials,  or  equipment. 

This  behavior  seems  to  involve: 

(1)  The  ability  to  recognize  the  importance  of  a  pilot  study 
before  using  a  particular  technique,  material,  or  equipment 

(2)  The  ability  to  select  that  part  of  the  problem  which  re¬ 
quires  preliminary  information  before  it  can  be  put  into 
effect 

(3)  Technical  know-how  to  conduct  a  pilot  study 

(k)  The  ability  to  evaluate  the  results  of  the  Btudy  in  the 
light  of  desired  objectives 

An  item  intended  to  predict  this  behavior: 

Describe  a  situation  in  which  a  problem  is  currently  being 
studied.  Ask  the  examinee  to  decide  whether  a  new  but  untried 
technique  should  be  used  for  the  current  problem.  This  should 
sample  (l)  above. 


II,  Planning  and  Designing  the  Investigation 
F,  Anticipating  Difficulties 

5.  TOOK  SPLCIaL  PRECAUTIONS  IN  PLANNING  TO  PREVENT  DawaGE 
TO  EQUIPMENT, 

This  behavior  seems  to  involve: 

(1)  Personal  attitude  or  outside  pressure  which  demands  that 
attempts  be  made  to  keep  damage  to  equipment  at  a  minimum 

(2)  The  ability  to  anticipate  where  damage  might  occur  in 
particular  equipment 

(3)  The  ability  to  think  of  end  evaluate  techniques  that  would 
reduce  the  possibility  of  such  damage 
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An  item  intended  to  predict  this  behavior: 

Illustrate  and  describe  a  piece  of  equipment  and  state  that  it  is 
particularly  susaeptible  to  damage*  Offer  as  alternatives  various 
warnings  to  operators  or  changes  in  apparatus  and  require  examinee  to 
select  the  one  most  likely  to  decrease  incidence  of  accidents  to  ap¬ 
paratus*  This  should  sample  (3)  above. 


II*  Planning  and  Designing  the  Investigation 
G,  Determining  the  Number  of  Observations 

1.  OUTLINED  PLAN  OF  INVESTIGATION  WHICH  PROVIDED  FOR  SUF¬ 
FICIENT  QUANTITY  OF  DaTa  TO  BE  TAKEN. 

This  behavior  seems  to  involve: 

(1)  Concern  about  whether  or  not  data  are  sufficient 

(2)  The  ability  to  judge  what  would  be  sufficient  or  insufficient 
data  for  the  problem  at  hand 

(3)  Including  the  judgment  made  in  (2)  as  a  part  of  the  plan  of 
investigation 

An  item  intended  to  predict  this  behavior: 

Describe  an  experiment'  in  which  data  insufficient  as  a  basis  for 

conclusions  have  been  collected.  Other  five  alternatives,  fburof  which 
indicate  that  data  so  far  obtained  are  sufficient  or  more  than  suf¬ 
ficient*  The  fifth  alternative  should  describe  a  program  for  the 
collection  of  necessary  data  in  the  most  efficient  manner* 


III*  Conducting  the  Investigation 

A,  Developing  Methods,  Materials,  or  Equipment 

1.  DEVISED  AN  IMPROVED  METHOD,  MATERIAL,  OR  EQUIPMENT. 

This  behavior  seems  to  involve: 

(1)  The  ability  to  detect  a  deficiency  in  existing  methods, 
materials,  or  equipment. 

(2)  A  desire  to  correct  the  deficiency 

(3)  The  ability  to  analyze  the  source  of  the  deficiency 

(4)  A  store  of  experience  from  which  to  develop  possible  cor¬ 
rections  for  the  deficiency 

(5)  The  ability  to  evaluate  these  connections  in  the  light  of 
(l)  and  (3),  and  to  select  the  most  appropriate  correction 

An  item  intended  to  predict  this  behavior: 

Describe  a  piece  of  apparatus  and  the  purpose  it  is  to  serve. 
Offer  as  alternatives  changes  in  the  apparatus  and  require  examinee 
to  select  the  change  that  would  be  of  greatest  value  in  accomplish¬ 
ing  the  purpose.  This  should  sample  (l),  (3),  and  (5). 
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Ill*  Conducting  the  Investigation 

A*  Developing  Methods,  Materials,  or  Equipment 

1.  (Ineffective)  DEVELOPED  A  UEW  METHOD  WHEN  APPROPRIATE 
ONE  EXISTED. 

This  behavior  seems  to  involve; 

(1)  Recognition  of  a  problem 

(2)  A  lack  of  knowledge  of  existing  methods  appropriate  to  the 
solution  of  the  problem  and/or 

(3)  A  poor  evaluation  of  the  worth  of  appropriate  existing 
methods  for  the  solution  of  the  problem  and/or 

(4)  A  failure  to  recognise  the  cost  in  time  and  money  involved 
in  instituting  new  methods. 

An  item  intended  to  predict  this  behavior: 

Describe  a  problem  that  requires  a  piece  of  equipment  with  cer¬ 
tain  specifications.  Present  five  pieces  of  equipment  in  diagram 
form*  Two  of  these  would  fulfill  the  specifications  but  one  oust  be 
specially  constructed*  Ask  the  examinee  to  select  the  most  appro¬ 
priate.  This  should  sample  (3)  or  (4)  above. 


Ill*  Conducting  the  Investigation 

B*  Applying  Methods  and  Techniques 

1,  USED  a  TECHNIQUE,  i-jaT^IaL,  OR  BmUIriuihT  WHICH  SOLVED 
PROBLEM  OR  ELIMINATED  DIFFICULTY  IN  THE  INVESTIGATION. 

This  behavior  seems  to  involve: 

(1)  The  ability  to  think  of  possible  techniques  to  solve  the 
problem 

(2)  The  ability  to  predict  the  consequences  of  the  techniques 
available 

(3)  The  ability  to  select  the  most  appropriate  technique  for 
the  purpose 

An  item  intended  to  predict  this  behavior: 

Describe  a  problem  concerning  the  use  of  a  particular  instru¬ 
ment  or  technique.  Ask  the  examinee  to  select  from  a  list  of  five 
procedures  the  one  that  would  best  solve  the  problem* 

III,  Conducting  the  Investigation 

B.  Applying  Methods  and  Technioues 

2.  POINTED  OUT  THaT  METHOD  OR  DEVICE  DID  NOT  MEET  THE  RE¬ 
QUIREMENTS  OF  THE  INVESTIGATION. 

This  behavior  seems  to  involve: 

(1)  The  ability  to  identify  the  requirements  of  the  problem 

(2)  The  ability  to  evaluate  methods  and  devices  with  reaped 
to  the  requirements  oi  the  problem  and  thus  identify 
which  are  appropriate  and  which  inappropriate 
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An  item  intended  to  predict  this  behavior: 


Present  a  detailed  description  of  equipment  and  its  use.  Ask 
exaMnee  to  select  the  ohief  disadvantage  of  the  equipment  for  this 
use.  This  should  san^le  (l)  and  (2)  above. 


III,  Conducting  the  Investigation 

B,  Applying  Methods  and  Techniques 

3.  SUBSTITUTED  A  I.ETH0D,  TECHNIQUE,  uR  rUilruoNT  GIVING 
RESULTS  BETTER  THaN  THE  ONE  IN  CURRENT  USE. 

This  behavior  seems  to  involve: 

(1)  A  familiarity  with  existing  methods,  techniques,  or  equipment 

(2)  The  ability  to  detect  weaknesses  in  current  techniques 

(3)  The  ability  to  think  up  and  evaluate  possible  substitutes  for 

(1) 

An  itam  intended  to  predict  this  behavior: 

Describe  a  common  measurement  problem  and  list  five  possible  but 
unconventional  techniques  for  its  solution.  Ask  the  examinee  to  se¬ 
lect  the  best  technique.  This  should  sample  (3)  above. 


Ill,  Conducting  the  Investigation 

B,  Applying  i-ethoos  and  Techniques 

4.  USED  SUBSTITUTE  MATERIAL  OR  SIMPLIFIED  PROCEDURE  THaT  MET 
STANDARDS  AND  SaTED  MONEY  AND  TIME. 

This  behavior  seems  to  involve: 

(1)  Recognising  that  there  are  delects  in  present  materials  or 
procedures 

(2)  Thinking  o?  ways  to  eliminate  or  lessen  the  effect  of  these 
defects 

(3)  Evaluating  these  substitute  materials  or  procedures  in  the 
light  of  the  standards  of  the  problem 

(4)  Selecting  the  most  appropriate 

An  item  intended  to  predict  this  behavior: 

Describe  the  characteristics  of  five  different  materials.  De¬ 
scribe  a  situation  in  which  one  of  the  materials  could  best  be  used, 
resulting  in  economy  of  time  or  funds.  Ask  the  examinee  to  select 
the  material  that  would  be  most  appropriate,  Tlda  should  sample  (3) 
and  (4)  above. 

III.  Conducting  the  Investigation 

B.  Applying  Methods  and  Techniques 

6,  TAUGHT  HIMSELF  TO  OPERATE  EQUIPMENT  WITHOUT  SUPERVISION. 

This  behavior  seess  to  involve: 

The  ability  to  deduce  the  operating  principles  of  a  piece  of 
equipment  on  the  basis  of  minimal  cuss,  such  as  examination 
cf  the  equipment  itself,  study  of  operating  manuals,  or  a 
knowledge  of  the  operation  of  similar  equipment. 


An  item  intended  to  predict  this  bohaviort 

Present  a  detailed  diagram  of  a  piece  of  equipment  and  a  general 
statement  of  its  function*  List  five  possible  steps  in  operating 
the  equipment  that  could  be  taken.  Ask  the  exaadnM  to  select  the 
first  step  in  operating  the  equipment.  This  should  saaple  the  above. 

Ill*  Conducting  the  Investigation 

C.  Modifying  Planned  provedures 

6.  ANTICIPATED  THE  PRO  TABLE  EFFECT  OF  A  DEFECT  OR 
DIFFICULT*  AND  TOOK  APPROPRIATE  ACTION. 

Tills  behavior  seems  to  involve i 

(1)  The  ability  to  foresee  possible  difficulties 

(2)  Taking  an  inventory  of  available  procedures  which  might 
remedy  the  defect 

(3)  Selecting  the  remedy  that  will  provide  the  most  satisfac¬ 
tory  solution 

An  item  intended  to  predict  this  behavior* 

Describe  a  situation  in  which  a  defect  is  developing  and  offer 
as  alternatives  an  inventory  of  available  materials  or  procedures. 
Examinee  rust  select  alternative  that  will  provide  the  best  remedial 
effect  when  properly  applied. 

III.  Conducting  the  Investigation 

D.  APPLYING  THEORY 

Tliis  behavior  seems  to  involve* 

(1)  The  ability  to  understand  thoroughly  a  scientific 
generalization 

(2)  The  ability  to  recognize  a  specific  example  of  tne 
generalization 

(3)  .The  behaviors  reported  in  the  list  of  critical  require¬ 

ment::  under  III-D 

An  item  intended  to  predict  this  behavior: 

Illustrate  a  scientific  generalisation  by  example  and  imply  the 
principle  involved.  List  five  possible  illustrations  of  the  general¬ 
ization  and  ask  the  examinee  to  select  the  one  which  is  not  illus¬ 
trative  of  the  principle.  This  should  sample  (1)  and  (2)  above. 

III.  C  nducting  the  Investigation 
D  Applying  Theory 

*.  PSRPCPPED  AN  UNFAMILIAR  CALCULATION  OR  OPERATION 
1ITHCUT  INSTRUCTION. 

This  behavior  seems  to  involve: 

(1)  The  ability  to  assimilate  new  information  about  an 
unfardliar  calculation  or  operation 

(2)  The  ability  to  apply  this  new  infon»ation  according  to 
rules  peculiar  to  the  calculation  or  operation 
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An  Item  intended  to  predict  this  behavior: 

Supply  a  series  of  rules  concerning  an  unfamiliar  mathematical 
system.  Ask  the  examinee  to  use  these  rules  in  the  solution  of 
a  aeries  of  problems.  This  should  sample  (1)  and  (2)  above. 

III.  Conducting  the  Investigation 
D.  Applying  Theory 

2.  )ADE  AN  APPLICATION  OF  N3.  OH  COMPLEX  MATERIAL  TO  OWN 
WORK  ArTER  PRIE?  EXPLANATION. 

This  behavior  seems  to  involve: 

(1)  The  ability  to  understand  new  or  complex  material 

(2)  The  ability  to  perceive  the  relationships  between  the  new 
or  complex  material  and  other  problems 

(3)  The  ability  to  apply  (2)  to  the  solution  of  a  problem 

An  item  intended  to  predict  ^his  behavior: 

Describe  a  set  of  symbols  and  present,  statements  concerning  their 
relationship'-.  Ask  the  examinee  to  apply  this  material  in  the  solution 
of  a  series  of  problems.  This  should  sample  (1),  (2),  and  (3)  above, 

III.  Conducting  ths  Investigation 
D.  Applying  Theory 

L.  TRANSFORM)!  FHTbICAL  i*C3L£M  SO  THAT  IT  COULD  BE 
SOLVED  Hf  f  A ? HEDATICAL  ANALYSIS. 

This  behavior  seems  to  involve: 

(1)  The  ability  to  recognize  when  a  mathematical  representation 
of  a  problem  is  desirable 

(2)  The  ability  to  recognize  which  aspects  of  a  problem  are 
susceptible  to  mathematical  analysis 

(3)  The  ability  to  make  this  transformation 

An  item  intended  to  predict  this  behavior: 

Describe  the  variables  of  a  problem  and  li3t  five  possible 
ways  of  representing  these  variables.  Ask  the  examinee  to  sel*"'* 
the  kind  of  representation  that  best  fits  the  problem.  This  should 
sample  (1)  above. 

III.  Conducting  the  Investigation 
D»  Applying  Theory 

6.  DETEHJINSL  THE  BURcCSE  OH  OPERATIC:'  Or  «  DEVICE  BY 
STOWING  I  To  (XTiSTKUCTJOM. 

Tiiis  behavior  seems  to  involve: 

(1)  Application  of  knowledge  of  mechanical  principles  -  for 
example,  relating-  kiwwledge  cl  parts  of  similar  devices 

to  new  situation  and  hypothesizing  about  functions  of  parts 

(2)  Testing  of  hypotheses  by  physical  or  mental  r ampliations 

of  parts 

(3}  Organizing  conclusions  about  functions  of  rarts  to  deduce 
function  of  apparatus  as  a  whole 
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(U)  Selecting  possible  apolications  related  to  the  function 
and  judging  practicality  of  the  apparatus  for  each  such 
purpose 

An  item  intended  to  predict  this  behavior: 

Present  a  diagram  of  an  apparatus  and  describe  its  parts. 

List  five  possible  uses  of  the  apparatus  and  ask  the  examinee 
to  select  the  use  for  rhich  the  apparatus  is  best  suited*  This 
should  s amnio  (3)  and  (h)  above. 

III.  Conducting  the  Investigation 

E.  Attending  to  and  Checking  Details 

1.  FULLOftED  aLL  ESSENTIAL  DETAILS  OF  PRESCRIBED  PRO- 
Cri  UrtES  FDR  A  ROUTINE  OPERATION. 

This  behavior  seems  to  involve: 

(1)  A  recognition  of  which  details  of  prescribed  procedures 
are  essential,  or 

(2)  A  practice  of  following  prescribed  procedures  letter  for 
letter 

An  item  intended  to  predict  this  behavior: 

Describe  a  procedure  for  a  simple  experiment  and  sgk  the  examinee 
to  select  an  unessential  detail.  This  should  sample  (1)  above. 

III.  Conducting  the  Investigation 

E.  Attending  to  and  Checking  Details 

3.  HANDED  IN  LORK  ONLY  AFTER  HE  HaD  CHECKED  IT. 

This  behavior  seems  to  involve: 

(1)  Cor  r  about  accuracy 

(2)  Ml.  vness  to  undertake  the  extra  labor  involved  in 
checking  results 

An  item  intended  to  predict  this  behavior: 

Present  partially  completed  calculations  of  experimental 
results  that  contain  an  error,  ask  the  examinee  to  select  the 
value  to  be  reported.  This  should  sample  (1)  and  (2)  above. 

III.  Conducting  the  Investigation 

F.  ANaLfLING  THE  DMA 

This  behavior  seems  to  involve: 

(1)  Information  about  techniques  available  and  their  applica¬ 
bility  to  various  situations 
'2)  Knowledge  of  how  to  apply  those  techniques 

An  item  intended  to  predict  this  behavior: 

Present  data  from  an  investigation,  and  offer  as  alternatives 
simple  ways  of  analyzin..  data;  have  examinee  select  the  most  appro¬ 
priate  one.  This  should  sample  (1)  and  (2)  above. 


IV.  Interpreting  Research  Results 
A.  Evaluating  findings 

1.  PRODUCED  CONCLUSIONS  OR  RECOMMENDATIONS  SUPPORTED  Ef 
nATA. 

This  behavior  seems  to  involve: 

(1)  A  point  of  view  that  prevents  hasty  selection  of  con¬ 
clusions 

(2)  The  ability  to  analyze  a  set  of  data 

(3)  The  ability  to  apply  logical  principles 

(k)  The  ability  to  draw  the  correct  conclusion  and  not  to 
accept  conclusions  unsupported  try  the  data 

An  item  intended  to  predict  this  behavior: 

Describe,  an  experimental  procedure  and  the  results  obtained. 

List  five  possible  conclusions  and  ask  the  examinee  to  select 
the  conclusion  supported  by  the  data.  This  should  sample  (1),  (2), 
(3)  and  (4)  above. 

IV.  Interpreting  Research  Results 
A.  Evaluating  Findings 

2,  DREli  CONCLUSIONS  IN  ACCORDANCE  WITH  CORRECT  LOGICAL 
PRINCIPLES. 

This  behavior  seems  to  involve: 

(l)  The  ability  to  understand  what  is  involved  in  a  set  of 
data  or  propositions 

(2)  The  ability  to  recognize  what  is  and  is  not  necessarily 
implied  by  these  data  or  propositions,  or 

(3)  The  ability  to  formulate  a  valid  generalization  from 
these  data  or  propositions 

An  item  intended  to  predict  this  behavior; 

Present  a  proposition  and  list  five  implications  of  the  pro¬ 
position.  Ask  the  examinee  to  select  an  implication  that  necessarily 
follows  from  the  proposition.  This  should  sample  (1)  and  (2)  above. 

Present  a  series  of  propositions  expressing  relationships 
among  a  set  of  variables.  Ask  the  examinee  to  solve  several 
problems  by  logical  manipulation  of  these  propositions.  This 
should  sample  (1)  and  (2)  above. 

IV.  Interpreting  Research  Results 
A.  Evaluating  Findings 

5.  POINTED  OUT  WHETHER  OK  NOT  THE  EVIDENCE  LAS  CONCLUSIVE. 
This  behavior  seems  to  involve: 

(1)  Tho  ability  to  judge  relevance  of  the  evidence  to  the 
conclusions  drawn 

(2)  The  ability  to  evaluate  the  conclusiveness  of  the 
evidence 


An  item  intended  to  predict  this  behavior: 

Describe  an  experimental  problem,  its  design,  and  the  results 
obtained.  List  several  possible  conclusions  and  ask  the  examinee 
to  juuge  v/hether  or  not  the  evidence  clearly  justifies  each  con¬ 
clusion.  This  should  saw, pie  (1)  and  (2)  above. 

IV.  Interpreting  Research  Results 

A.  Evaluating  Findings 

6.  ft INTEL  OUT  THE  LIMITATIONS  OF  DATa  OR  METHOD, 

INCLUDING  CONILICTIONG  RLE! ENTS. 

This  behavior  seems  to  involve: 

(1)  The  ability  to  recognize  what  requirements  must  be  met 
before  conclusions  can  be  drawn 

(2)  The  ability  to  recognize  when  these  requirements  have 
been  met  and  when  they  have  net 

(3)  The  ability  to  detect  inconsistencies  in  data 

An  item  intended  to  predict  this  behavior: 

Describes  a  problem  and  present  data  inadequate  for  its 
solution.  Give  the  examinee  the  opportunity  to  select  a  conclusion 
based  on  inadequate  data  or  to  recognize  the  inadequacy.  This 
should  sample  (1)  and  (2)  above. 

Describe  an  experimental  procedure  and  the  results  obtained. 

Ask  the  examinee  to  result  that  is  inconsistent  vdth  a  particular 
condition  of  the  experiment.  This  should  sample  (3)  above. 

IV.  Interpreting  Research  Results 

B.  Pointing  Out  Implications  of  Data 

2.  FORKED  OUT  API  LIGATION!'  TO  OTHER  PROBLEMS  OR  FIELDS. 

This  behavior  seems  to  involve: 

(1)  Knowledge  of  the  nature  of  related  problems  in  the  same 
field  or  in  related  fields;  this  includes  a  general 
knowledge  of  the  variables,  current  findings,  and  theories 
relative  to  such  problems 

(2)  The  ability  to  perceive  relationships  between  results  of 
a  current  problem  and  related  problems 

An  item  intended  to  predict  this  behavior: 

Present  findings  that  may  be  expected  to  have  considerable 
effect  in  a  number  of  fields.  Ask  examinee  to  choose  field  in 
which  effect  will  be  least. 

Prevent  a  description  of  five  materials  and  ask  the  examinee 
which  material  would  be  best  applied  in  specific  related  fields. 

This  should  sample  (1)  and  (2)  above. 


1*3 


V.  Preparing  Reports 

A.  DESCRIBING  AND  ILLUSTRATING  WORK 

This  behavior  seems  to  involve: 

(1)  The  ability  to  recognize  the  importance  of  certain 
factors  in  describing  and  illustrating  work,  for  example, 
clarity  and  conciseness 

(2)  The  ability  to  achieve  theso  factors 

(3)  The  ability  to  judge  when  these  factors  have  been  achieved 

An  item  intended  to  predict  this  behavior: 

Describe  an  experiment  and  present  five  alternative  ways  of 
stating  findings.  Only  one  of  these  statements  should  meet  standards 
for  conciseness  and  brevity.  Selecting  this  alternative  should 
demonstrate  (1)  and  (3)  above. 

V.  Preparing  Reports 

A.  Describing  and  Illustrating  Work 

2.  (Ineffective)  GAVE  EXCESSIVE  DETAIL  IN  DESCRIPTIVE 
MATERIAL. 

This  behavior  seems  to  involve: 

(1)  An  inability  to  determine  which  details  are  pertinent  to 
the  objectives  of  a  specific  report  and  Ahich  are  not, 
and/or 

(2)  A  desire  to  "pad"  the  report 

An  item  intended  to  predict  this  behavior: 

Present  an  excessively  detailed  paragrapn  taken  from  a  scientific 
report.  List  five  possible  criticisms  of  the  paragraph  and  ask  the 
examinee  to  select  the  most  pertinent.  This  should  sample  (1) 
above. 

V.  Preparing  Reports 

A.  Describing  and  Illustrating  Work 

6.  USED  GRAPHIC,  TADULi.R,  OR  PICTORIAL  MATERIAL  TO  CLARIFY 

TEXT. 


This  behavior  seems  to  involve: 

(1)  Recognizing  the  value  of  illustrative  material  in 
clarifying  text 

(2)  Recognizing  which  type  of  illustrative  material  is  most 
appropriate  for  particular  data 

An  item  intended  to  predict  this  behavior: 

Present  a  list  of  five  types  of  data  and  ask  the  examinee  tc 
select  the  one  which  would  most  appropriately  be  presented  in 
graphic  form  in  a  research  report.  This  should  sample  (2)  above. 


V.  Preparing  Reports 

R.  Substantiating  Procedures  and  Findings 

2.  DELC tIEEL  aLL  pIGuIFICANT  ELEhEnTS  OF  EXFET.Il’ENT, 
CONDITIONS,  AND  RESULTS. 

This  benavxor  seers  to  involve: 

(1)  /n  understanding  that  a  report  is  a  history  of  an  experiment 
and  mat  information  having  any  bearing  on  the  experiment 

is  a  necessary  inclusion  in  the  report. 

(2)  An  understanding  tnat  the  report  serves  two  sain  purposes* 
(a)  communicates  findings;  (b)  allows  repetition  of  his 
work  (and  warns  of  unprofitable  procedures). 

An  item  intended  to  predict  this  behavior: 

Present  five  alternative  organizations  of  a  research  report 
and  ask  the  examinee  to  select  the  most  appropriate  one.  This 
should  sample  (1)  and  (2)  above. 

Describe  all  the  results  of  an  experiment  and  ask  the  examinee 
to  select  the  recults  that  should  be  reported.  This  should  sample 
(1)  and  (2)  above. 

V.  Preparing  Reports 

B.  Substantiating  Procedures  and  Findings 

In  (Ineffective)  0! ITT ED  DETAILS  NECES-ART  FOR  APPLICATION 
OR  CHECKING  OF  kORK, 

This  behavior  seems  to  involve: 

Recognition  oi  the  necessity  of  including  in  a  report 
details  sufficient  for  others  to  apply  or  to  check  the 
work. 

An  item  intended  to  predict  this  behavior: 

Present  a  portion  of  a  report  that  fails  to  report  the  methods 
used  in  obtaining  certain  results  ana  list  criticisms  that  might 
be  applied  to  the  repoit.  Ask  the  examinee  to  select  the  most 
appropriate  criticism.  This  should  sample,  in  part,  the  behavior 
described  above. 

V.  Preparing  Reports 

C.  OnGhNIZlt.'G  THE  REPORT 

This  behavior  soems  to  involve: 

(1)  A  realization  that  information  necessary  to  the  under¬ 
standing  of  other  sections  of  the  report  should,  in 
general,  precede  them 

(2)  A  realisation  that  the  steps  in  procedures  should  be 
reported  in  tne  oraer  in  which  they  were  taken 

An  item  intended  to  predict  this  behavior: 

Present  a  poorly  organized  oaragraph  taken  from  a  scientific 
report.  Ask  th~  examinee  to  select  the  most  appropriate  criticism  of 
the  paragraph.  This  should  sample  (1)  and  (?)  above. 


V.  Preparing  Reports 

C.  Organizing  the  Report 

7.  PLAC.iD  LENGTH*  OR  DETAILED  ANALYSIS  OR  DATA  IN  APriNDIX. 
This  behavior  seems  to  involve : 

(1)  Knowledge  of  standard  practice  in  organizing  research 
reports 

(2)  Understanding  of  the  relative  advantages  of  alternative 
ways  of  organizing  reports 

An  item  intended  to  predict  this  behavior: 

Present  five  kinds  of  material  to  he  included  in  a  report, 
several  of  which  might  be  placed  in  an  appendix.  The  examinee 
would  demonstrate  (1)  and  (2)  by  selecting  the  kind  of  material 
that  most  clearly  belongs  in  the  appendix. 

V.  Preparing  Reports 

L.  Using  Appropriate  Style  in  Presenting  Report 
1.  USED  A  STILE  aDaPTEL  TO  AUDIENCE  OR  READERS. 

This  behavior  seems  to  involve: 

(1)  An  appreciation  of  the  styles  of  composition  appropriate 
to  specific  audiences 

(2)  An  ability  to  use  the  appropriate  style 

An  item  intended  to  predict  this  behavior: 

Present  an  inappropriately  informal  paragraph  taken  from 
a  scientific  report.  Ask  the  examinee  to  select  the  most  appro¬ 
priate  criticism  of  the  paragraph.  This  should  sajtple  (1)  above. 

VI.  Administering  Research  Projects 

A.  Selecting  and  Training  Personnel 

2.  ASSIGNED  WORKER  A  PROJECT  SUITING  ABILITY  OR  TRAINING. 

This  behavior  seems  to  involve: 

(1)  Obtaining  sufficient  information  about  the  requirements 
of  the  job 

(2)  Procuring  sufficient  information  about  the  skills  and 
interests  of  available  personnel 

(3)  Assigning  personnel  to  specific  projects  on  the  basis  of 
information  obtained  in  (1)  and  (2) 

An  item  intended  to  predict  this  behavior: 

Describe  some  qualifications  of  personnel  available  for  job.  Also 
describe  some  job  requirements.  Examinee  should  base  choice  on  fact 
that  neither  type  of  inform  ti'  .i  is  sufficiently  detailed  for  use 
as  a  basis  for  assignment  oi  best  irorKer  tc  the  jcb. 

Describe  the  duties  of  a  particular  position  and  list  five 
different  levels  of  training.  Ask  the  examinee  to  select  the  level 
of  training  necessary  for  the  job.  This  should  sample  (3)  above. 


Vic  Administering  Research  Projects 

A.  Selecting  and  Training  Personnel 

7.  MADE  SUGGESTIONS  TO  SUBORDINATES  ONLY  AFTER  LEARNING 
DETAILS. 

This  behavior  seems  to  involve* 

(1)  A  preference  for  familiarizing  oneself  with  relevant 
information  before  making  a  decision  or  suggestion 

(2)  The  ability  to  use  this  preference  in  an  appropriate 
situation 

An  item  intended  to  predict  this  behavior* 

Describe  a  situation  in  which  a  suggestion  might  be  made  io- 
mediately.  Offer  alternatives  which  require  the  examinee  to  decide 
whether  a  suggestion  should  be  made  immediately  or  whether  mor« 
information  is  necessary.  This  should  sample  (1)  and  (2)  above. 


VI.  Administering  Research  Projects 
B.  Dealing  V.ith  Subordinates 

a.  ADMINISTERING  REPRIMANDS,  RECOGNITION,  AND  PRAISE. 

This  behavior  seems  to  involve* 

(1)  An  ability  to  decide  objectively  whether  reprimand, 
recognition,  or  praise  is  called  for 

(2)  An  ability  to  devise  an  appropriate  reprimand,  recog¬ 
nition,  or  praise 

(3)  Administering  (2) 

An  item  intended  to  predict  this  behavior: 

Describe  a  situation  in  which  a  subordinate  has  been  guilty 
of  unethical  behavior.  Offer,  as  alternatives,  methods  of  dealing 
with  the  man.  Require  examinee  to  select  the  alternative  that 
would  be  most  appropriate  to  the  offense  and  would  do  most  to 
preserve  morale  of  other  workers.  This  would  sample  (2)  above. 

Describe  a  situation  in  which  an  unwarranted  reprimand  has 
been  administered.  List  five  possible  actions  that  could  be  taken. 
Ask  the  examinee  to  select  the  most  appropriate  action.  This 
should  sample,  in  part,  (1)  and  (2)  above* 

VI,  Administering  Research  Projects 
B.  Dealing  V.'it 'i  Subordinates 

b.  LOOKING  OUT  FOR  SUBORDINATES'  WELFARE. 

This  behavior  seems  to  involve: 

(1)  A  point  of  view  that  demands  concern  about  the  welfare 
of  all  subordinates 

(2)  The  ability  to  taka  administrative  actions  which  provide 
for  the  welfare  of  subordinates 

An  iter,  intended  to  predict  this  behavior: 

Describe  a  situation  in  which  an  administrative  decision  af¬ 
fecting  the  welfare  of  subordinates  must  be  made.  List  five  possible 
decisions  and  ask  the  examinee  to  select  the  most ‘appropriate  de¬ 
cision.  Tills  should  sample  (1)  and  (2)  above. 
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VI.  Administering  Research  Projects 

B.  Dealing  With  Subordinates 

b. -  Looking  Out  for  Subordinates'  welfare 

1.  ARRANGED  A  SCHEDULE  ACCEPTABLE  TO  SUBORDINATES 

This  behavior  seems  to  involve* 

(1)  Recognition  that  the  convenience  and  satisfaction  of 
subordinates  should  be  considered  in  arranging  a  work 
schedule 

(2)  Choosing  or  adopting  a  schedule;  compatible  with  subordi¬ 
nates'  convenience  as  far  as  possible  in  a  specific 
situation 

An  item  intended  to  predict  this  behavior: 

Describe  a  situation  in  which  an  administrative  decision 
affecting  the  schedule  of  a  subordinate  must  be  made.  List  five 
possible  decisions  and  ask  the  examinee  to  select  the  roost  appro¬ 
priate  decision.  This  should  sample  (1)  and  (2)  above. 

VI.  Administering  Research  Projects 

B.  Dealing  1.1th  Subordinates 
d.  Sharing  Responsibility 

2.  ASKED  NCR  OR  ACCEPTED  SUBORDINATES'  IDEAS. 

This  behavior  seems  to  involves 

(1)  A  recognition  that  subordinates  may  contribute  sub¬ 
stantially  to  the  solution  of  a  technical  problem 

(2)  A  willingness  to  consider  subordinates'  suggestions 
in  specific  situations 

(3)  A  positive  effort  to  solicit  the  suggestions  of  sub¬ 
ordinates 

An  item  intended  to  predict  this  behavior: 

Describe  a  situation  in  which  a  technical  decision  in  the 
planning  of  a  research  project  is  to  be  made  and  state  the  action 
taken  by  the  administrator.  The  examinee  ia  asked  to  select  the ‘action 
he  would  take  in  the  situation.  This  should  sample  (1),  (2)  and 

(3)  above, 

VI.  Administering  Research  Projects 

C.  Planning  and  Coordinating  the  ;.ork  of  Groups 
b.  Estimating  and  Supplying  Project  Needs 

1.  OUTLINED  AND  SCHEDULED  PERSONNEL  NEEDS. 

This  behavior  seems  to  involve: 

(1)  The  ability  to  prepare  a  detailed  plan  which  includes 

a  breakdown  of  steps  involved  in  the  total  project,  working 
hours  required,  and  the  number  anu  type  of  personnel  needed 
for  each  step 

(2)  The  ability  to  translate  these  plans  into  a  working  schedule, 
assigning  available  personnel  to  specific  units  of  work 
throughout  all  phases  of  the  schedule 

(3)  The  ability  to  revise  the  schedule  as  demanded  by  current 
personnel  ne«ds 
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An  item  intended  to  predict  this  behaviort 

Describe  a  situation  which  requires  a  revision  in  the  work 
schedule  for  a  research  project.  List  fivo  possible  actions  and 
ask  the  examinee  to  select  the  most  appropriate  action,  liiis  should 
sample  (3)  above. 

VI.  Administering  Research  Projects 

C.  Planning  and  Coordinating  the  i.ork  of  Groups 

b.  Estimating  and  Supplying  Project  Needs 

3.  FAILED  TO  .tE'^UEST  R  CILITIES  VIA  PROPER  CHANELS. 

This  behavior  seems  to  involve* 

(1)  Not  knowing  the  proper  channels  through  which  to  request 
facilities 

(2)  In  the  event  that  these  channels  are  not  made  explicit, 
being  unable  to  decide  upon  the  most  appropriate  channels 
through  the  use  of  social  skills 

An  item  intended  to  predict  this  behavior: 

Liescribo  a  situation  in  v.hich  facilities  must  be  requested, 
and  list  five  alternative  approaches  for  making  the  request. 

Ask  the  examinee  to  select  the  most  appropriate  action.  This  should 
sample  (2)  above. 


VI.  Administering  Research  Projects 

C.  Planning  and  Coordinating  the  I.ork  cf  Groups 

c.  ORGANISING  THE  Y.ORK  OF  PROJECTS. 

This  behavior  seems  to  involve: 

(1)  Familiarity  with  the  over-all  purposes  of  the  research 
program 

(2)  The  ability  to  evaluate  the  contributions  of  individual 
projects  or  phases  of  projects  to  these  purposes 

(3)  The  ability  to  assign  appropriate  priorities  to  them  on 
the  basia  of  (1)  and  (2) 

An  item  intended  to  predict  this  behavior: 

Describe  a  research  program  and  list  its  various  phases.  Ask 
the  examinee  which  phases  are  to  receive  the  most,  and  which  the 
least,  priority.  This  should  sample  (2)  and  (3)  above. 


VI,  Administering  Research  Projects 

C.  Planning  and  Coordinating  the  fork  of  Groups 

d.  UNIFYING  RELATED  GROUPS. 

This  behavior  seems  to  involve: 

(1)  Recognition  of  the  importance  of  unifying  the  work  of 
related  groups 

(2)  information  ana  techniques  necessary  to  effect  a  func¬ 
tional  unification 
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An  item  intended  to  predict  this  behavior: 

Describe  e  situation  in  which  an  administrator  oust  select  a 
policy  involving  techniques  to  coordinate  the  worK  of  several 
divisions  in  a  laboratory*  List  five  policies  and  ask  the  ex¬ 
aminee  to  select  the  policy  that  fills  the  purpose  most  ade¬ 
quately*  This  should  sample  (1)  and  (2)  above. 


VI*  Administering  Research  Projects 

D.  MAKING  ADMINISTRATIVE  DECISIONS 

This  behavior  seems  to  involve: 

(1)  Making  decisions  when  necessary 

(2)  Deciding  on  the  basis  of  regulations  in  force  and  the 
problem  at  hand 

(3)  Arriving  at  the  best  decision  possible 

An  item  intended  to  predict  this  behavior: 

Describe  a  situation  in  which  an  administrative  decision 
must  be  made  and  list  five  possible  decisions.  Ask  the  examinee 
to  select  the  most  appropriate  one.  This  should  sample  (1),  (2), 
and  (3)  above. 


VI.  Administering  Research  Projects 

D.  Making  Administrative  Decisions 

b.  Following  Regulations  in  Decisions 

1.  DEVIATED  FROM  STANDARD  ADMINISTRATIVE  PROCEDURE 
TO  HANDLE  EMERGENCY. 

This  behavior  seems  to  involve: 

(1)  Familiarity  with  standard  administrative  procedure 

(2)  The  ability  to  recognize  an  emergency  situation 

(3)  The  ability  to  make  a  judgment  that  the  situation 
requires  deviation  from  standard  procedure 

An  item  intended  to  predict  this  behavior: 

Describe  a  particular  emergency  situation  in  which  an  ad¬ 
ministrative  decision  must  be  made.  Present  alternative  decisions, 
one  of  which  calls  for  deviation  from  standard  procedure  to  handle 
the  emergency.  In  selecting  this  choice,  the  examinee  must  per¬ 
form  steps  (2)  and  (3). 


VI.  Administering  Research  Projects 

D.  Making  Administrative  Decisions 
c.  Basing  Decisions  on  Facts 

1.  LECIDSD  ONLY  AFTER  GATHERING  ALL  PERT INERT  FACTS. 

This  behavior  seems  to  involve: 

(1)  An  attitude  of  suspending  judgment  where  possible  until 
sufficient  information  is  available 

(2)  Making  decision  to  gather  needed  facts  in  specific 
situations 
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An  item  intended  to  predict  this  behavior* 


Describe  a  situation  in  thich  the  work  of  two  groups  is  not 
adequately  coordinated.  Give  the  examinee  the  opportunity  to  make 
a  decision  concerning  the  tro  groupa  on  inmiffidleni'lcforshtlen  cr  to 
suspend  Judgment.  This  should  sample  (1)  above. 


VI.  Administering  Research  Projects 
E.  Working  With  Other  Groups 

2.  GOT  OPPOSING  UPOUPS  TO  AGREE 

This  behavior  seems  to  involve j 

(1)  The  ability  and  desire  to  be  tactful 
(?)  The  ability  and  desire  to  be  persuasive 
(3)  Fairness 

An  item  intended  to  predict  this  behavior: 

Describe  a  situation  in  which  two  groups  are  in  disagreement; 
present  alternative  courses  of  action  ir.  handling  the  situation, 
the  best  choice  jiving  the  asst  opportunity  for  (1)  and  (2)  to  Le 
exercised. 


VII.  Acceptirg  Organizational  Responsibility 
A.  Performing  Own  Work 

b.  Accepting  Resoonsibility  for  Own  T.ork 

It,  (ineffective)  LEFT  INCO/ PLETE  IOP.K  IN  SUCH  CON¬ 
DITION'  THAT  OTHERS  COULD  NOT  COkFLSTE  IT. 

This  b •‘■•ivior  seex^  to  involve: 

(])  The  lack  of  a  Doint  of  view  that  holds  the  po*-i  j  of  the 
re  .-ch  over  other  more  per  o.ial  /* als  md/or 
(?)  Th  •  ;  -.•fc  :  .  Ity  to  reco.r  ite  t  .it  leaving  v  ?Hc  ir.  a  con- 
di  .  ;  -itti'  others  to  .irry  a.t  on  benefits  the 
cv-.-a  1  goals  cf  the  resea* on 


An  item  inter.?. 


sreiict  this  xehav *  • 


Place  a r.  irdi" „i*ial  ir.  the  posit’  :i  cf  loavinr  a  p*t 
ask  hir.  to  select  tr.e  action  witn  highest  priority  for  *• 
tine  re’.airi..g,  i.e. ,  preparing  to  leave  his  work  sc  that 
may  continue  it  cost  efficiently. 


ject  a-'d 
c  li-i  ’ed 
succt ..  sor 


VII.  Accepting  Organizational  Kesj'cnsibility 
A.  r*r:  crri..g  >n  Work 

c.  ...lit cetir.g  Own  Tine  and  Effort 

3.  TIC  a  Ch  Ail  ITIO.mIL  ;.UiK  VCLiC.'TAEILf 

Tr..s  behavior  seems  to  involve: 

VI  ‘  A  -cs.tiva  att.tude  toward  the  achievement  of  the  central 
,*'ul  of  a  work  program 

(?)  m n  under  staining  cr  correct  identification  cf  the  central 
g  ai  :f  a  *crx  program 

(3/  A  wiliingTie ■  s  to  undertake  additional  werk  in  an  effort 
to  achieve  the  central  goal 
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An  item  intended  to  predict  this  behavior: 

Describe  a  work  program  in  which  an  administrative  decision 
must  be  reached  concerning  a  man  who  took  on  additional  work. 
List  five  possible  decisions  and  ask  the  examinee  to  select  the 
most  appropriate  one.  This  should  sample  (1)  and  (2)  above. 


VII.  Accepting  Organizational  Responsibility 
A.  Performing  Own  Work 

c.  Allocating  Own  Time  and  Effort 

3.  (Ineffective)  OPE^JT  TT:.£  DO  IMG  TORE  WORK  Oil  AN 
ASSIGNMENT  THAN  DESTKABL£  CONSIDERING  THE  ilATURE 
OF  THE  AoSIGhLENT. 

This  behavior  seems  to  involve: 

(1)  The  inability  to  understand  or  a  failure  to  define  the 
central  goal  of  a  particular  assignment,  and/or 

(2)  The  inability  to  keep  the  central  goals  of  the  research 
ao  the  primary  criterion  of  quality  and  quantity  of  rork 
desired 

An  item  intended  to  predict  this  behavior: 

Describe  a  situation  in  which  a  decision  must  be  made  concern¬ 
ing  allocation  of  time  and  effort  and  list  five  possible  directions 
toward  which  to  allocate  time.  Ask  the  examinee  to  select  the  roost 
appropriate.  This  should  sample  (1)  and  (?)  above. 

• 

VII.  Accepting  Organizational  Responsibility 
A.  Performing  Own  Work 

c.  Alloc.- ting  Own  Time  and  Effort 

i*.  CPGA.IIEED  ACER  TO  PERMIT  D-RRHCG  OUT  SEVERAL 
LOVERS/:  TASKS  CO.vC  JiE.'iTLl  * 

This  behavior  seem'  to  itwj’.ve: 

(1)  Tne  ability  to  work  at  high  efficiency,  .viich  seems  to  involve 

(a)  Making  motions  Serve  as  ssapy  desired  purposes  as  possible 

(b)  Doing  no  more  than  proper  prosecution  of  task  requires 

(2)  The  desire  to  rorx  efficiently' 

An  item  interred  to  predict  this  behavior: 

Describe  a  situation  in  which  a  job  cust  be  organized  in  the 
roost  efficient  manner  and  list  five  possible  ways  of  organizing 
the  lob.  Ask  the  examinee  to  select  the  most  efficient  way  of 
doing  the  job.  This  should  sample  (1)  above. 
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VII.  Accepting  Organizational  Responsibility 
B.  Assisting  in  the  Work  of  Others 

3.  KEPT  INTERESTED  PERSONS  AND  GROUPS  FULLY  INFORMED  ON 
PROGRESS  OF  PROJECT. 

This  behavior  seems  to  involve; 

(1)  Understanding  of  the  purpose  of  reporting  on  progress 
regularly 

(2)  The  ability  to  utilize  appropriate  techniques  for  reporting 
on  progress 

(3)  Concern  for  keeping  others  informed 

An  item  intended  to  predict  this  behavior: 

Describe  a  situation  in  which  the  writing  of  a  progress  report 
is  considered  and  in  which  an  objection  is  raised  to  writing  the 
report.  List  five  possible  criticisms  of  the  objection  and  ask  the 
examinee  to  select  the  most  pertinent  criticism.  This  should  sample 

(l)  above. 


VII.  Accepting  Organizational  Responsibility 

B.  Assisting  in  the  Y/ork  of  Others 

6.  POINTED  OUT  INADEQUACIES  OF  A  PLAN,  REGULATION,  OR 
POLICY  TO  GROUP  RESPONSIBLE  FOR  IT. 

This  behavior  seems  to  involve: 

(1)  The  ability  to  recognize  that  a  plan,  regulation,  or 
policy  is  inadequate  in  certain  respects 

(2)  The  recognition  that  something  should  be  done  to  remedy 
the  inadequacy 

(3)  The  recognition  that  it  is  usually  most  desirable  to 
approach  those  responsible  for  the  inadequacy  first 

An  item  intended  to  predict  this  behavior: 

Describe  a  situation  in  which  a  plan  for  coordinating  the  work 
of  two  groups  is  not  working  efficiently,  since  the  work  of  one  group 
is  being  delayed  by  the  other  group.  List  several  actions  that  the 
head  of  the  former  group  might  take,  one  of  which  is  to  confer  witv 
the  head  of  the  slow  group.  Ask  the  examinee  to  select  the  most  ap 
propriate  action.  This  should  sample,  in  part,  (1),  (2),  and  (3)  above. 


VII.  Accepting  Organizational  Responsibility 
C.  SUBORDINATING  PERSONAL  INTERESTS 

This  behavior  seems  to  involves 

(1)  The  understanding  of  the  central  goals  of  a  work  program 

(2)  The  recognition  that,  in  addition  to  one’s  own  interests, 
the  interests  or  ideas  of  others  might  be  of  value  in 
achieving  the  central  goals  of  a  work  program. 


% 


% 
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An  item  intended  to  predict  this  behavior? 

Describe  a  situation  in  which  a  decision  must  be  made  concerning 
the  planning  of  the  direction  in  which  work  of  a  project  will  go. 

List  five  possible  decisions  and  ask  the  examinee  to  decide  whether 
it  is  advisable  to  subordinate  the  central  goals  of  the  project  to 
the  supervisor's  interests.  This  should  sample  (l) g  aad  (2)  in¬ 
directly. 


VII,  Accepting  Organizational  Responsibility 
D,  Accepting  Regulations  and  Supervision 

1.  REQUESTED  CLARIFICATION  OF  ASSIGNMENT  V.HEN  .  DOUBT. 

This  behavior  seems  to  involve} 

The  ability  to  recognize  when  a  situation  is  ambiguous 
and  demands  clarification 

An  item  intended  to  predict  this  behavior: 

Describe  an  ambiguous  situation  and  require  the  examinee  to 
recognize  it  as  such,  by  choosing  a  course  of  action  that  will  lead 
to  clarification.  This  should  sample  the  above. 


VII.  Accepting  Organizational  Responsibility 
D.  Accepting  Regulations  and  Supervision 

2.  SOLICITED  AID  FROL  SUPERIOR  1  HEN  FACED  WTH  DIFFICULTIES. 

This  behavior  seems  to  involve: 

(1)  Recognizing  a  situation  that  individual  is  not  capable  of 
coping  with  alone 

(2)  Realizing  that  it  is  most  effective  to  request  aid  im¬ 
mediately  without  wasting  time 

An  item  intended  to  predict  this  behavior: 

Describe  a  situation  calling  for  a  decision  that  an  individual 
is  not  capable  of  making.  From  five  possible  lines  of  action,  the 
examinee  must  select  the  one  that  suggests  asking  for  help  from  a 
superior.  In  doing  so,  the  examinee  must  perform  (1)  and  (?'  aV^ve, 


VIII,  Accepting  Personal  Responsibility 
A.  Adapting  to  Associates 

1.  CRITICIZED  THE  YORK  OF  ANOTHER  WITHOUT  DISPARAGING 
HIS  EFFORTS. 

This  behavior  seems  to  involve: 

(1)  A  recognition  that  the  feelings  (sgos)  of  others  are  in¬ 
volved  in  their  work,  and  that  individuals  perform  better 

>  if  they  are  not  personally  criticized 

(2)  The  ability  to  ori'er  a  crfti ci sm  or  suggestion  tactfully 
through  such  techniques  as  (a)  first  discussing  the  prob¬ 
lem  to  learn  the  individual's  gcreral  approach,  knowledge, 
and  opinions  about  ths  problem,  and  (b)  bringing  in  the 
criticism  or  suggestion  at  an  appropriate  time  and  in  a 
tactful  manner 
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An  item  intended  to  predict  this  behavior* 

Present  a  situation  in  which  the  work  done  by  one  staff  mem¬ 
ber  has  definite  shortcomings.  Allow  examinee  to  decide  whether 
or  not  he,  as  a  co-worker,  would  criticize  the  work  of  the  other, 
and  if  so,  whether  he  would  select  the  choice  describing  a  criti¬ 
cism  least  calculated  to  belittle  the  other. 


VIII.  Accepting  Personal  Responsibility 
A.  Adapting  to  Associates 

h.  (Ineffective)  QUARRELLED  WITH  OR  SPOKE  RUDELY  TO 
OTHER  STAFF  MEtGSRS 

This  behavior  seems  to  involve? 

(1)  The  failure  to  recognize  the  importance  of  maintaining 
amicable  relationships  with  other  staff  members,  and/or 

(2)  The  inability  to  control  one's  behavior  so  that  it  is 
compatible  with  maintaining  amicable  relationships. 

An  item  intended  to  predict  this  behavior: 

Describe  a  situation  in  which  one  of  the  staff  members  is 
unnecessarily  rude  to  another  member  of  the  staff.  List  five 
other  courses  of  action  and  ask  the  examinee  to  select  the  most 
appropriate  one.  This  should  sample  (l)  above. 


VIII.  Accepting  Personal  Responsibility 
B.  Adapting  to  Job  Demands 

2.  CONTINUED  TO  WORK  ACCORDING  TO  PLAN  IN  SPITE  OF 
OBSTACLES  OR  OPPOSITION. 

This  behavior  seems  to  involve: 

(1)  A  continuing  strong  conviction  that  the  plan  of  a  partic¬ 
ular  piece  of  work  is  the  best  available  for  that  work 

(2)  The  skills  necessary  to  act  on  that  conviction  in  the 
face  of  opposition 

(3)  The  ability  to  avoid  being  dissuaded  from  fulfilling  that 
convi ction 

An  item  intended  to  predict  this  behavior: 

Describe  a  situation  in  which  a  man  is  convinced  that  his 
present  way  of  attacking  a  problem  is  the  plan  that  should  be 
followed;  also  describe  various  obstacles  to  fulfilling  the  plan. 
The  examinee  must  choose  to  continue  with  the  plan  when  offered 
five  choices  of  action  to  be  taken. 


* 
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VIII.  Accepting  Personal  Responsibility 
C.  MEET7.NQ  PERSONAL  COMMITMENTS 


This  behavior  seems  to  involve t 

(1)  Concern  Tor  meeting  commitments 

(2)  Willingness  to  put  forth  considerable  effort  in  order  to 
meet  commitments 

(3)  Acceptance  of  responsibility  for  failure  to  meet  commit¬ 
ments  and/or  efforts  to  take  the  “next  best"  course 

kn  item  intended  to  predict  this  behavior: 

Describe  a  situation  in  which  there  is  a  failure  to  meet  a 
commitment.  List  five  possible  ways  of  reducing  the  seriousness 
of  the  failure  and  ask  the  examinee  to  select  the  most  effective 
way.  This  should  sample  (3)  above. 


VIII.  Accepting  Personal  Responsibility 
C.  Meeting  Personal  Commitments 

1.  (Ineffective)  FAILED  TO  PERFORM  A  SPECIFICALLY 
ASSIGNED  TASK  TO  WHICH  HE  HAD  AGREED, 

This  behavior  seems  to  involve: 

(1)  Concern  for  meeting  commitments 

(2)  Willingness  to  put  forth  considerable  effort  in  order 
to  meet  commitments 

An  item  intended  to  predict  this  behavior: 

Describe  a  situation  in  which  an  individual  has  made  a 
commitment  but  finds  that  he  will  have  considerable  difficulty 
in  meeting  it.  A  list  of  alternative  lines  of  action  is  presented. 
The  examinee  should  choose  the  alternative  indicating  that  the 
individual  will  meet  his  commitment  even  though  it  involves  per¬ 
sonal  inconvenience.  In  order  to  prevent  the  item  from  being  too 
obvious  the  correct  answer  is  limited  to  only  a  part  of  what  is 
considered  to  be  the  best  action  in  this  situation.  This  should 
sample  (1)  and  (2)  above. 


VIII.  Accepting  Personal  Resoonsibility 
D.  BEING  FAIR  AND  ETHICAL 

This  behavior  seems  to  involve: 

(1)  Considering  or  presenting  all  evidence  objectively 

(2)  Being  truthful  in  all  communications 

(3)  Giving  credit  where  credit  is  due 

(li)  Taking  responsibility  for  own  actions 

An  item  intended  to  predict  this  behavior: 

Describe  a  situation  where  criticism  may  be  expected  if  J'l) 
is  done;  examinee  must  recognize  that  (1)  is  nevertheless  neces¬ 
sary.  This  recognition  of  the  necessary  action  does  not,  of  course 
assure  that  the  examinee  would  actually  perform  comparable  behavior 
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Inscribe  a  situation  in  which  an  error  has  bssn  coaalttad  and 
list  five  possible  reasons  offered  by  the  individual  who  wads  the 
error#  Ask  the  examinee  to  select  the  most  ethical  reason#  This 
should  sample  (U)  above. 


VIII.  Accepting  Personal  Responsibility 
D.  Being  Fair  and  Ethical 

2.  GAVE  CREDIT  FOR  IDEAS  OR  WORK  TO  THOSE  RESPONSIBLE. 
This  behavior  seems  to  involve! 

(1)  A  concern  for  fair  distribution  of  credit  for  ideas  or 
other  work 

(2)  A  recognition  that  all  who  had  a  responsible  part  in  a 
project  should  be  given  credit 

An  item  intended  to  predict  this  behaviors 

Describe  a  situation  in  which  an  administrative  policy  must 
be  set  concerning  distribution  of  credit  for  work#  List  five  pos¬ 
sible  policies  and  ask  the  examinee  to  select  the  most  ethical 
policy#  This  should  sample  (1)  and  (2)  above. 


VIII.  Accepting  Personal  Responsibility 
E.  Showing  Interest  in  Work 

1.  WORKED  ON  OWN  TIKE  TO  IMPROVE  TECHNICAL  KNOWLEDGE 
AND  PROFICIENCY. 

This  behavior  seems  to  involves 

A  strong  interest  in  and  desire  to  learn  more  about 
one's  work 

An  item  intended  to  predict  this  behaviors 

Describe  briefly  the  work  of  a  group  of  five  research  workers 
concerned  with  the  same  project.  Include  in  the  description  the 
actions  of  each  which  might  indicate  interest  in  the  work,  the  action 
of  one  being  extensive  study  of  material  related  to  the  problem  on 
his  own  time.  The  actions  of  the  others  should  be  less  outstanding. 
Ask  the  examinee  to  evaluate  the  men  by  selecting  the  one  who  the 
evidence  suggests  would  he  the  most  desirable  worker.  The  item  would 
measure  recognition  of  the  value  of  personal  effort  to  improve  own 
technical  knowledge  and  proficiency. 


VIII ?  Accepting  Personal  Responsibility 
E.  Showing  Interest  in  Work 

k„  ASKED  SUBORDINATES  TO  EDUCATE  HIM  BY  EXPLAINING 
THEIR  VORK  IN  DETAIL. 

This  -behavior  seems  to  involve: 

(1)  A  strong  interest  in  one's  work 

(2)  A  recognition  that  a  subordinate,  by  a  detailed  explana¬ 
tion  of  his  worx,  might  be  able  to  add  to  the  information 
of  a  super-visor 
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An  item  Intended  to  predict  this  behavior* 

Describe  a  situation  in  which  a  supervisor  asks  a  subordinate 
to  report  on  the  details  of  his  work.  The  examinee  is  asked  to 
evaluate  this  actiom  This  should  aespls  (2)  above. 
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Appendix  IV 


DISTRIBUTIONS  CP  RESPONSES  FOR  EACH  ITEM  OF  THE  FINAL  TRIOUT  FORMS 


Appendix  IV  contains  tabulations  of  the  number  of  examinees  se¬ 
lecting  each  response  for  final  tryout  forms  of  test  items,  Ex¬ 
aminees  included  those  groups  described  in  the  project  report  fir 
the  final  tryouts  held  at  the  University  of  Pittsburgh  and  Iowa 
State  College.  In  addition,  data  obtained  from  the  earlier  try¬ 
outs  were  included  whenever  the  particular  item  remained  unchanged 
in  both  earlier  and  final  tryout  forms.  The  total  number  of  re¬ 
sponses,  therefore,  varies  for  individual  items. 

The  data  are  presented  in  two  tables,  for  Tryout  Form  A  (75  itgms) 
and  Tryout  Form  B  (90  items).  These  forms  contain  the  same  items 
used  in  the  final  tryouts,  although  individual  tryout  groups  did 
not  take  all  of  the  items  contained  in  these  two  forms.  Each  table 
lists  the  item  number,  number  of  examinees  selecting  response  A,  B, 
C,  D,  or  E,  the  number  omitting  the  item,  and  the  total  number  of 
examinees  attempting  the  item.  In  each  case  the  response  intended 
as  correct  is  underlined. 

The  final  form  of  the  test  was  developed  from  the  tryout  forms  after 
revision  based  on  tryout  dat«  and  critics*  review.  The  data  re¬ 
ported  here  apply  only  to  the  tryout  forms. 
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